Oct 16 07:24:07 user nova-compute[74080]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74080) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74080) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74080) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 07:24:07 user nova-compute[74080]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:24:07 user nova-compute[74080]: INFO nova.virt.driver [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 16 07:24:07 user nova-compute[74080]: INFO nova.compute.provider_config [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Acquiring lock "singleton_lock" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Acquired lock "singleton_lock" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Releasing lock "singleton_lock" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Full set of CONF: {{(pid=74080) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ******************************************************************************** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Configuration options gathered from: {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ================================================================================ {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] allow_resize_to_same_host      = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] arq_binding_timeout            = 300 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] backdoor_port                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] backdoor_socket                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] block_device_allocate_retries  = 300 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] block_device_allocate_retries_interval = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cert                           = self.pem {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute_monitors               = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] config_dir                     = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] config_drive_format            = iso9660 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] config_source                  = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] console_host                   = user {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] control_exchange               = nova {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cpu_allocation_ratio           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] daemon                         = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] debug                          = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] default_access_ip_network_name = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] default_availability_zone      = nova {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] default_ephemeral_format       = ext4 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] default_green_pool_size        = 1000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] default_schedule_zone          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] disk_allocation_ratio          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] enable_new_services            = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] enabled_apis                   = ['osapi_compute'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] enabled_ssl_apis               = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] flat_injected                  = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] force_config_drive             = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] force_raw_images               = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] graceful_shutdown_timeout      = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] heal_instance_info_cache_interval = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] host                           = user {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instance_build_timeout         = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instance_delete_interval       = 300 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instance_format                = [instance: %(uuid)s]  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instance_name_template         = instance-%08x {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instance_usage_audit           = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instance_usage_audit_period    = month {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] internal_service_availability_zone = internal {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] key                            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] live_migration_retry_count     = 30 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_config_append              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_dir                        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_file                       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_options                    = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_rotate_interval            = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_rotate_interval_type       = days {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] log_rotation_type              = none {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] long_rpc_timeout               = 1800 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] max_concurrent_builds          = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] max_concurrent_live_migrations = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] max_concurrent_snapshots       = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] max_local_block_devices        = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] max_logfile_count              = 30 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] max_logfile_size_mb            = 200 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] maximum_instance_delete_attempts = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] metadata_listen                = 0.0.0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] metadata_listen_port           = 8775 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] metadata_workers               = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] migrate_max_retries            = -1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] mkisofs_cmd                    = genisoimage {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] my_ip                          = 10.0.0.210 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] network_allocate_retries       = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] osapi_compute_listen_port      = 8774 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] osapi_compute_unique_server_name_scope =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] osapi_compute_workers          = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] password_length                = 12 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] periodic_enable                = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] periodic_fuzzy_delay           = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] pointer_model                  = ps2mouse {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] preallocate_images             = none {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] publish_errors                 = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] pybasedir                      = /opt/stack/nova {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ram_allocation_ratio           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rate_limit_burst               = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rate_limit_except_level        = CRITICAL {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rate_limit_interval            = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] reboot_timeout                 = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] reclaim_instance_interval      = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] record                         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] reimage_timeout_per_gb         = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] report_interval                = 120 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rescue_timeout                 = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] reserved_host_cpus             = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] reserved_host_disk_mb          = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] reserved_host_memory_mb        = 512 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] reserved_huge_pages            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] resize_confirm_window          = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] resize_fs_using_block_device   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] resume_guests_state_on_host_boot = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rpc_response_timeout           = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] run_external_periodic_tasks    = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] running_deleted_instance_action = reap {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] running_deleted_instance_poll_interval = 1800 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] running_deleted_instance_timeout = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler_instance_sync_interval = 120 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_down_time              = 720 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] servicegroup_driver            = db {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] shelved_offload_time           = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] shelved_poll_interval          = 3600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] shutdown_timeout               = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] source_is_ipv6                 = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ssl_only                       = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] state_path                     = /opt/stack/data/nova {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] sync_power_state_interval      = 600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] sync_power_state_pool_size     = 1000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] syslog_log_facility            = LOG_USER {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] tempdir                        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] timeout_nbd                    = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] transport_url                  = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] update_resources_interval      = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] use_cow_images                 = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] use_eventlog                   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] use_journal                    = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] use_json                       = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] use_rootwrap_daemon            = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] use_stderr                     = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] use_syslog                     = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vcpu_pin_set                   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plugging_is_fatal          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plugging_timeout           = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] virt_mkfs                      = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] volume_usage_poll_interval     = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] watch_log_file                 = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] web                            = /usr/share/spice-html5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_concurrency.disable_process_locking = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.auth_strategy              = keystone {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.compute_link_prefix        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.dhcp_domain                = novalocal {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.enable_instance_password   = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.glance_link_prefix         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.instance_list_per_project_cells = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.list_records_by_skipping_down_cells = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.local_metadata_per_cell    = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.max_limit                  = 1000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.metadata_cache_expiration  = 15 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.neutron_default_tenant_id  = default {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.use_forwarded_for          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.use_neutron_default_nets   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.vendordata_dynamic_targets = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.vendordata_jsonfile_path   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.backend                  = dogpile.cache.memcached {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.backend_argument         = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.config_prefix            = cache.oslo {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.dead_timeout             = 60.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.debug_cache_backend      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.enable_retry_client      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.enable_socket_keepalive  = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.enabled                  = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.expiration_time          = 600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.hashclient_retry_attempts = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_dead_retry      = 300 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_password        =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_pool_maxsize    = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_sasl_enabled    = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.memcache_username        =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.proxies                  = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.retry_attempts           = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.retry_delay              = 0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.socket_keepalive_count   = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.socket_keepalive_idle    = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.socket_keepalive_interval = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.tls_allowed_ciphers      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.tls_cafile               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.tls_certfile             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.tls_enabled              = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cache.tls_keyfile              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.auth_section            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.auth_type               = password {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.cafile                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.certfile                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.collect_timing          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.cross_az_attach         = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.debug                   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.endpoint_template       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.http_retries            = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.insecure                = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.keyfile                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.os_region_name          = RegionOne {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.split_loggers           = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cinder.timeout                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.cpu_dedicated_set      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.cpu_shared_set         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.image_type_exclude_list = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.max_concurrent_disk_ops = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.max_disk_devices_to_attach = -1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.resource_provider_association_refresh = 300 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.shutdown_retry_interval = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] conductor.workers              = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] console.allowed_origins        = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] console.ssl_ciphers            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] console.ssl_minimum_version    = default {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] consoleauth.token_ttl          = 600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.cafile                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.certfile                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.collect_timing          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.connect_retries         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.connect_retry_delay     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.endpoint_override       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.insecure                = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.keyfile                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.max_version             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.min_version             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.region_name             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.service_name            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.service_type            = accelerator {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.split_loggers           = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.status_code_retries     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.status_code_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.timeout                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] cyborg.version                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.backend               = sqlalchemy {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.connection            = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.connection_debug      = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.connection_parameters =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.connection_recycle_time = 3600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.connection_trace      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.db_inc_retry_interval = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.db_max_retries        = 20 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.db_max_retry_interval = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.db_retry_interval     = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.max_overflow          = 50 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.max_pool_size         = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.max_retries           = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.mysql_wsrep_sync_wait = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.pool_timeout          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.retry_interval        = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.slave_connection      = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] database.sqlite_synchronous    = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.backend           = sqlalchemy {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.connection        = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.connection_debug  = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.connection_parameters =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.connection_recycle_time = 3600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.connection_trace  = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.db_inc_retry_interval = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.db_max_retries    = 20 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.db_max_retry_interval = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.db_retry_interval = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.max_overflow      = 50 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.max_pool_size     = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.max_retries       = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.pool_timeout      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.retry_interval    = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.slave_connection  = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] api_database.sqlite_synchronous = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] devices.enabled_mdev_types     = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ephemeral_storage_encryption.enabled = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.api_servers             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.cafile                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.certfile                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.collect_timing          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.connect_retries         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.connect_retry_delay     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.debug                   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.default_trusted_certificate_ids = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.enable_certificate_validation = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.enable_rbd_download     = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.endpoint_override       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.insecure                = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.keyfile                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.max_version             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.min_version             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.num_retries             = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.rbd_ceph_conf           =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.rbd_connect_timeout     = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.rbd_pool                =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.rbd_user                =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.region_name             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.service_name            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.service_type            = image {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.split_loggers           = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.status_code_retries     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.status_code_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.timeout                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.verify_glance_signatures = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] glance.version                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] guestfs.debug                  = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.config_drive_cdrom      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.config_drive_inject_password = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.enable_instance_metrics_collection = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.enable_remotefx         = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.instances_path_share    =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.iscsi_initiator_list    = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.limit_cpu_features      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.power_state_check_timeframe = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.use_multipath_io        = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.volume_attach_retry_count = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.vswitch_name            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] mks.enabled                    = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] image_cache.manager_interval   = 2400 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] image_cache.precache_concurrency = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] image_cache.remove_unused_base_images = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] image_cache.subdirectory_name  = _base {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.api_max_retries         = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.api_retry_interval      = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.auth_section            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.auth_type               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.cafile                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.certfile                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.collect_timing          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.conductor_group         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.connect_retries         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.connect_retry_delay     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.endpoint_override       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.insecure                = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.keyfile                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.max_version             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.min_version             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.peer_list               = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.region_name             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.serial_console_state_timeout = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.service_name            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.service_type            = baremetal {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.split_loggers           = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.status_code_retries     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.status_code_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.timeout                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ironic.version                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] key_manager.fixed_key          = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.barbican_api_version  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.barbican_endpoint     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.barbican_endpoint_type = public {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.barbican_region_name  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.cafile                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.certfile              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.collect_timing        = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.insecure              = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.keyfile               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.number_of_retries     = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.retry_delay           = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.send_service_user_token = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.split_loggers         = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.timeout               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.verify_ssl            = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican.verify_ssl_path       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.auth_section = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.auth_type = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.cafile   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.certfile = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.collect_timing = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.insecure = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.keyfile  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.split_loggers = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] barbican_service_user.timeout  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.approle_role_id          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.approle_secret_id        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.cafile                   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.certfile                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.collect_timing           = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.insecure                 = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.keyfile                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.kv_mountpoint            = secret {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.kv_path                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.kv_version               = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.namespace                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.root_token_id            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.split_loggers            = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.ssl_ca_crt_file          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.timeout                  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.use_ssl                  = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.auth_section          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.auth_type             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.cafile                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.certfile              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.collect_timing        = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.connect_retries       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.connect_retry_delay   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.endpoint_override     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.insecure              = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.keyfile               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.max_version           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.min_version           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.region_name           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.service_name          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.service_type          = identity {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.split_loggers         = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.status_code_retries   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.status_code_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.timeout               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] keystone.version               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.connection_uri         =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.cpu_mode               = custom {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: WARNING oslo_config.cfg [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.cpu_power_governor_high = performance {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.cpu_power_governor_low = powersave {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.cpu_power_management   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.device_detach_attempts = 8 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.device_detach_timeout  = 20 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.disk_cachemodes        = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.disk_prefix            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.enabled_perf_events    = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.file_backed_memory     = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.gid_maps               = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.hw_disk_discard        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.hw_machine_type        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.images_rbd_glance_store_name =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.images_rbd_pool        = rbd {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.images_type            = default {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.images_volume_group    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.inject_key             = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.inject_partition       = -2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.inject_password        = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.iscsi_iface            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.iser_use_multipath     = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_bandwidth = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_downtime = 500 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_inbound_addr = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_permit_post_copy = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_scheme  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_timeout_action = abort {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_tunnelled = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: WARNING oslo_config.cfg [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 16 07:24:07 user nova-compute[74080]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 16 07:24:07 user nova-compute[74080]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 16 07:24:07 user nova-compute[74080]: and ``live_migration_inbound_addr`` respectively.
Oct 16 07:24:07 user nova-compute[74080]: ).  Its value may be silently ignored in the future.
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.live_migration_with_native_tls = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.max_queues             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.nfs_mount_options      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.num_memory_encrypted_guests = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.num_pcie_ports         = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.pmem_namespaces        = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.quobyte_client_cfg     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rbd_secret_uuid        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rbd_user               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.remote_filesystem_transport = ssh {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rescue_image_id        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rescue_kernel_id       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rescue_ramdisk_id      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.rx_queue_size          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.smbfs_mount_options    =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.snapshot_compression   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.snapshot_image_format  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.sparse_logical_volumes = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.swtpm_enabled          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.swtpm_group            = tss {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.swtpm_user             = tss {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.sysinfo_serial         = unique {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.tb_cache_size          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.tx_queue_size          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.uid_maps               = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.use_virtio_for_bridges = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.virt_type              = kvm {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.volume_clear           = zero {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.volume_clear_size      = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.volume_use_multipath   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.vzstorage_cache_path   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.vzstorage_mount_user   = stack {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.auth_section           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.auth_type              = password {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.cafile                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.certfile               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.collect_timing         = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.connect_retries        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.connect_retry_delay    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.default_floating_pool  = public {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.endpoint_override      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.extension_sync_interval = 600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.http_retries           = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.insecure               = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.keyfile                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.max_version            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.min_version            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.ovs_bridge             = br-int {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.physnets               = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.region_name            = RegionOne {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.service_metadata_proxy = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.service_name           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.service_type           = network {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.split_loggers          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.status_code_retries    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.status_code_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.timeout                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] neutron.version                = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] notifications.bdms_in_notifications = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] notifications.default_level    = INFO {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] notifications.notification_format = unversioned {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] notifications.notify_on_state_change = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] pci.alias                      = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] pci.device_spec                = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] pci.report_in_placement        = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.auth_section         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.auth_type            = password {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.cafile               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.certfile             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.collect_timing       = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.connect_retries      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.connect_retry_delay  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.default_domain_id    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.default_domain_name  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.domain_id            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.domain_name          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.endpoint_override    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.insecure             = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.keyfile              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.max_version          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.min_version          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.password             = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.project_domain_id    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.project_domain_name  = Default {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.project_id           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.project_name         = service {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.region_name          = RegionOne {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.service_name         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.service_type         = placement {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.split_loggers        = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.status_code_retries  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.status_code_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.system_scope         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.timeout              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.trust_id             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.user_domain_id       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.user_domain_name     = Default {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.user_id              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.username             = placement {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] placement.version              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.cores                    = 20 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.count_usage_from_placement = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.injected_file_content_bytes = 10240 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.injected_file_path_length = 255 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.injected_files           = 5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.instances                = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.key_pairs                = 100 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.metadata_items           = 128 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.ram                      = 51200 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.recheck_quota            = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.server_group_members     = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] quota.server_groups            = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rdp.enabled                    = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.image_metadata_prefilter = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.max_attempts         = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.max_placement_results = 1000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.query_placement_for_image_type_support = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] scheduler.workers              = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.host_subset_size = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.isolated_hosts = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.isolated_images = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.pci_in_placement = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.track_instance_changes = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] metrics.required               = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] metrics.weight_multiplier      = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] metrics.weight_setting         = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] serial_console.enabled         = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] serial_console.port_range      = 10000:20000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] serial_console.serialproxy_port = 6083 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.auth_section      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.auth_type         = password {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.cafile            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.certfile          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.collect_timing    = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.insecure          = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.keyfile           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.send_service_user_token = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.split_loggers     = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] service_user.timeout           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.agent_enabled            = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.enabled                  = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.html5proxy_port          = 6082 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.image_compression        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.jpeg_compression         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.playback_compression     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.server_listen            = 127.0.0.1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.streaming_mode           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] spice.zlib_compression         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] upgrade_levels.baseapi         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] upgrade_levels.cert            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] upgrade_levels.compute         = auto {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] upgrade_levels.conductor       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] upgrade_levels.scheduler       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.auth_section = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.auth_type = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.cafile = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.certfile = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.insecure = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.keyfile = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vendordata_dynamic_auth.timeout = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.api_retry_count         = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.ca_file                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.cache_prefix            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.cluster_name            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.connection_pool_size    = 10 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.console_delay_seconds   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.datastore_regex         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.host_ip                 = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.host_password           = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.host_port               = 443 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.host_username           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.insecure                = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.integration_bridge      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.maximum_objects         = 100 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.pbm_default_policy      = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.pbm_enabled             = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.pbm_wsdl_location       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.serial_port_proxy_uri   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.serial_port_service_uri = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.task_poll_interval      = 0.5 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.use_linked_clone        = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.vnc_keymap              = en-us {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.vnc_port                = 5900 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vmware.vnc_port_total          = 10000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.auth_schemes               = ['none'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.enabled                    = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.novncproxy_port            = 6080 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.server_listen              = 0.0.0.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.vencrypt_ca_certs          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.vencrypt_client_cert       = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vnc.vencrypt_client_key        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.disable_rootwrap   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.enable_numa_live_migration = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.libvirt_disable_apic = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.client_socket_timeout     = 900 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.default_pool_size         = 1000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.keep_alive                = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.max_header_line           = 16384 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.ssl_ca_file               = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.ssl_cert_file             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.ssl_key_file              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.tcp_keepidle              = 600 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] zvm.ca_file                    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] zvm.cloud_connector_url        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] zvm.reachable_timeout          = 300 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.enforce_new_defaults = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.enforce_scope      = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.policy_default_rule = default {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.policy_file        = policy.yaml {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.connection_string     = messaging:// {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.enabled               = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.es_doc_type           = notification {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.es_scroll_size        = 10000 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.es_scroll_time        = 2m {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.filter_error_trace    = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.hmac_keys             = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.sentinel_service_name = mymaster {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.socket_timeout        = 0.1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.trace_requests        = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler.trace_sqlalchemy      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler_jaeger.process_tags   = {} {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler_jaeger.service_name_prefix = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] profiler_otlp.service_name_prefix = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] remote_debug.host              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] remote_debug.port              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.ssl      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_notifications.retry = -1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_messaging_notifications.transport_url = **** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.auth_section        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:07 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.auth_type           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.cafile              = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.certfile            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.collect_timing      = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.connect_retries     = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.connect_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.endpoint_id         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.endpoint_override   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.insecure            = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.keyfile             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.max_version         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.min_version         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.region_name         = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.service_name        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.service_type        = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.split_loggers       = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.status_code_retries = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.status_code_retry_delay = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.timeout             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.valid_interfaces    = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_limit.version             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_reports.file_event_handler = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] oslo_reports.log_dir           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_ovs_privileged.group  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] vif_plug_ovs_privileged.user   = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.flat_interface = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_ovs.isolate_vif         = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_vif_ovs.per_port_bridge     = False {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] os_brick.lock_path             = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] privsep_osbrick.capabilities   = [21] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] privsep_osbrick.group          = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] privsep_osbrick.helper_command = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] privsep_osbrick.user           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] nova_sys_admin.group           = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] nova_sys_admin.helper_command  = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] nova_sys_admin.user            = None {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG oslo_service.service [None req-7ca7cedd-833d-4a04-ba6a-125c10f4e52c None None] ******************************************************************************** {{(pid=74080) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 16 07:24:08 user nova-compute[74080]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 16 07:24:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Connecting to libvirt: qemu:///system {{(pid=74080) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc7cd4b9180> {{(pid=74080) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 16 07:24:08 user nova-compute[74080]: libvirt:  error : internal error: could not initialize domain event timer
Oct 16 07:24:08 user nova-compute[74080]: WARNING nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 16 07:24:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc7cd4b9180> {{(pid=74080) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Starting native event thread {{(pid=74080) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Starting green dispatch thread {{(pid=74080) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 16 07:24:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Starting connection event dispatch thread {{(pid=74080) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 16 07:24:08 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Connection event '1' reason 'None'
Oct 16 07:24:08 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 07:24:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.mount [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Initialising _HostMountState generation 0 {{(pid=74080) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 16 07:24:14 user nova-compute[74080]: INFO nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host capabilities <capabilities>
Oct 16 07:24:14 user nova-compute[74080]:   <host>
Oct 16 07:24:14 user nova-compute[74080]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 16 07:24:14 user nova-compute[74080]:     <cpu>
Oct 16 07:24:14 user nova-compute[74080]:       <arch>x86_64</arch>
Oct 16 07:24:14 user nova-compute[74080]:       <model>IvyBridge-IBRS</model>
Oct 16 07:24:14 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:14 user nova-compute[74080]:       <microcode version='1070'/>
Oct 16 07:24:14 user nova-compute[74080]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 16 07:24:14 user nova-compute[74080]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='ss'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='vmx'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='pcid'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='osxsave'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='hypervisor'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='arat'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='tsc_adjust'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='md-clear'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='stibp'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='arch-capabilities'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='ssbd'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='invtsc'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='rsba'/>
Oct 16 07:24:14 user nova-compute[74080]:       <feature name='skip-l1dfl-vmentry'/>
Oct 16 07:24:14 user nova-compute[74080]:       <pages unit='KiB' size='4'/>
Oct 16 07:24:14 user nova-compute[74080]:       <pages unit='KiB' size='2048'/>
Oct 16 07:24:14 user nova-compute[74080]:     </cpu>
Oct 16 07:24:14 user nova-compute[74080]:     <power_management>
Oct 16 07:24:14 user nova-compute[74080]:       <suspend_mem/>
Oct 16 07:24:14 user nova-compute[74080]:       <suspend_disk/>
Oct 16 07:24:14 user nova-compute[74080]:       <suspend_hybrid/>
Oct 16 07:24:14 user nova-compute[74080]:     </power_management>
Oct 16 07:24:14 user nova-compute[74080]:     <iommu support='no'/>
Oct 16 07:24:14 user nova-compute[74080]:     <migration_features>
Oct 16 07:24:14 user nova-compute[74080]:       <live/>
Oct 16 07:24:14 user nova-compute[74080]:       <uri_transports>
Oct 16 07:24:14 user nova-compute[74080]:         <uri_transport>tcp</uri_transport>
Oct 16 07:24:14 user nova-compute[74080]:         <uri_transport>rdma</uri_transport>
Oct 16 07:24:14 user nova-compute[74080]:       </uri_transports>
Oct 16 07:24:14 user nova-compute[74080]:     </migration_features>
Oct 16 07:24:14 user nova-compute[74080]:     <topology>
Oct 16 07:24:14 user nova-compute[74080]:       <cells num='2'>
Oct 16 07:24:14 user nova-compute[74080]:         <cell id='0'>
Oct 16 07:24:14 user nova-compute[74080]:           <memory unit='KiB'>8189224</memory>
Oct 16 07:24:14 user nova-compute[74080]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 16 07:24:14 user nova-compute[74080]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 07:24:14 user nova-compute[74080]:           <distances>
Oct 16 07:24:14 user nova-compute[74080]:             <sibling id='0' value='10'/>
Oct 16 07:24:14 user nova-compute[74080]:             <sibling id='1' value='20'/>
Oct 16 07:24:14 user nova-compute[74080]:           </distances>
Oct 16 07:24:14 user nova-compute[74080]:           <cpus num='6'>
Oct 16 07:24:14 user nova-compute[74080]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 16 07:24:14 user nova-compute[74080]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 16 07:24:14 user nova-compute[74080]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 16 07:24:14 user nova-compute[74080]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 16 07:24:15 user nova-compute[74080]:           </cpus>
Oct 16 07:24:15 user nova-compute[74080]:         </cell>
Oct 16 07:24:15 user nova-compute[74080]:         <cell id='1'>
Oct 16 07:24:15 user nova-compute[74080]:           <memory unit='KiB'>8206492</memory>
Oct 16 07:24:15 user nova-compute[74080]:           <pages unit='KiB' size='4'>2051623</pages>
Oct 16 07:24:15 user nova-compute[74080]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 07:24:15 user nova-compute[74080]:           <distances>
Oct 16 07:24:15 user nova-compute[74080]:             <sibling id='0' value='20'/>
Oct 16 07:24:15 user nova-compute[74080]:             <sibling id='1' value='10'/>
Oct 16 07:24:15 user nova-compute[74080]:           </distances>
Oct 16 07:24:15 user nova-compute[74080]:           <cpus num='6'>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 16 07:24:15 user nova-compute[74080]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 16 07:24:15 user nova-compute[74080]:           </cpus>
Oct 16 07:24:15 user nova-compute[74080]:         </cell>
Oct 16 07:24:15 user nova-compute[74080]:       </cells>
Oct 16 07:24:15 user nova-compute[74080]:     </topology>
Oct 16 07:24:15 user nova-compute[74080]:     <cache>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 16 07:24:15 user nova-compute[74080]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 16 07:24:15 user nova-compute[74080]:     </cache>
Oct 16 07:24:15 user nova-compute[74080]:     <secmodel>
Oct 16 07:24:15 user nova-compute[74080]:       <model>apparmor</model>
Oct 16 07:24:15 user nova-compute[74080]:       <doi>0</doi>
Oct 16 07:24:15 user nova-compute[74080]:     </secmodel>
Oct 16 07:24:15 user nova-compute[74080]:     <secmodel>
Oct 16 07:24:15 user nova-compute[74080]:       <model>dac</model>
Oct 16 07:24:15 user nova-compute[74080]:       <doi>0</doi>
Oct 16 07:24:15 user nova-compute[74080]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 16 07:24:15 user nova-compute[74080]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 16 07:24:15 user nova-compute[74080]:     </secmodel>
Oct 16 07:24:15 user nova-compute[74080]:   </host>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='alpha'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>clipper</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='armv6l'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>spitz</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>nuri</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>kzm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sx1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>z2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>tosa</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>n810</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>n800</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>terrier</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>midway</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>microbit</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>verdex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>highbank</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>akita</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>connex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>collie</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='armv7l'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>spitz</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>nuri</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>kzm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sx1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>z2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>tosa</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>n810</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>n800</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>terrier</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>midway</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>microbit</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>verdex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>highbank</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>akita</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>connex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>collie</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='aarch64'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>spitz</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>nuri</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>kzm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sx1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>z2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>tosa</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>n810</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>n800</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>terrier</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>midway</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>microbit</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>verdex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>raspi3b</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>highbank</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>akita</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>connex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>collie</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <acpi default='on' toggle='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='cris'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='i686'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>isapc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>microvm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='kvm'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <pae/>
Oct 16 07:24:15 user nova-compute[74080]:       <nonpae/>
Oct 16 07:24:15 user nova-compute[74080]:       <acpi default='on' toggle='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:       <apic default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='m68k'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>an5206</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>q800</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>next-cube</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='microblaze'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='microblazeel'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='mips'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='16'>malta</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='mipsel'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='16'>malta</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='mips64'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='16'>malta</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>pica61</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>magnum</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='mips64el'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='16'>malta</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>pica61</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>magnum</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='16'>boston</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='ppc'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mac99</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>40p</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>taihu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='ppc64'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>taihu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>40p</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mac99</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='ppc64le'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>taihu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>40p</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>mac99</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='riscv32'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='8'>spike</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>opentitan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='8'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='riscv64'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='8'>spike</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>shakti_c</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='8'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='s390x'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='sh4'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>shix</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>r2d</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='sh4eb'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>shix</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>r2d</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='sparc'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>SS-5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>SS-20</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>LX</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>SS-4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>SS-10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>Voyager</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='sparc64'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sun4u</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>niagara</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>sun4v</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='x86_64'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>64</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='1'>isapc</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>microvm</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='kvm'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <acpi default='on' toggle='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:       <apic default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='xtensa'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>sim</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>kc705</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>ml605</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx200</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx60</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]:   <guest>
Oct 16 07:24:15 user nova-compute[74080]:     <os_type>hvm</os_type>
Oct 16 07:24:15 user nova-compute[74080]:     <arch name='xtensaeb'>
Oct 16 07:24:15 user nova-compute[74080]:       <wordsize>32</wordsize>
Oct 16 07:24:15 user nova-compute[74080]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='4'>sim</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>kc705</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>ml605</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>virt</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx200</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>lx60</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 07:24:15 user nova-compute[74080]:       <domain type='qemu'/>
Oct 16 07:24:15 user nova-compute[74080]:     </arch>
Oct 16 07:24:15 user nova-compute[74080]:     <features>
Oct 16 07:24:15 user nova-compute[74080]:       <cpuselection/>
Oct 16 07:24:15 user nova-compute[74080]:       <deviceboot/>
Oct 16 07:24:15 user nova-compute[74080]:       <disksnapshot default='on' toggle='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     </features>
Oct 16 07:24:15 user nova-compute[74080]:   </guest>
Oct 16 07:24:15 user nova-compute[74080]: </capabilities>
Oct 16 07:24:15 user nova-compute[74080]: 
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-i440fx-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>i686</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='255'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'/>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='lm'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ide</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-q35-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>i686</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='288'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'/>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='lm'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-i440fx-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>i686</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='255'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'/>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='lm'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ide</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-q35-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>i686</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='288'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'/>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='lm'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-i440fx-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>x86_64</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='255'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>efi</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='invtsc'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='rsba'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ide</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-q35-6.2</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>x86_64</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='288'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>efi</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='invtsc'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='rsba'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-i440fx-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>x86_64</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='255'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>efi</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='invtsc'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='rsba'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ide</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 16 07:24:15 user nova-compute[74080]: <domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 07:24:15 user nova-compute[74080]:   <domain>kvm</domain>
Oct 16 07:24:15 user nova-compute[74080]:   <machine>pc-q35-jammy</machine>
Oct 16 07:24:15 user nova-compute[74080]:   <arch>x86_64</arch>
Oct 16 07:24:15 user nova-compute[74080]:   <vcpu max='288'/>
Oct 16 07:24:15 user nova-compute[74080]:   <iothreads supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:   <os supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='firmware'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>efi</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:     <loader supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>rom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pflash</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='readonly'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='secure'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>yes</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>no</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </loader>
Oct 16 07:24:15 user nova-compute[74080]:   </os>
Oct 16 07:24:15 user nova-compute[74080]:   <cpu>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-passthrough' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='hostPassthroughMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='maximum' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='maximumMigratable'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>on</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>off</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='host-model' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <vendor>Intel</vendor>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ss'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='vmx'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pcid'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='hypervisor'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arat'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='umip'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='md-clear'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='invtsc'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibpb'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='ibrs'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-stibp'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='rsba'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='erms'/>
Oct 16 07:24:15 user nova-compute[74080]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:     <mode name='custom' supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>qemu64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>qemu32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>phenom</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>pentium</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>n270</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm64</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>kvm32</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>coreduo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>core2duo</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>athlon</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Westmere</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Snowridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Skylake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>SandyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Penryn</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G5</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G4</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G3</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Opteron_G2</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Opteron_G1</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>IvyBridge</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Icelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Haswell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Rome</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-Milan</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>EPYC</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Dhyana</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cooperlake</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>Conroe</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='no'>Broadwell</model>
Oct 16 07:24:15 user nova-compute[74080]:       <model usable='yes'>486</model>
Oct 16 07:24:15 user nova-compute[74080]:     </mode>
Oct 16 07:24:15 user nova-compute[74080]:   </cpu>
Oct 16 07:24:15 user nova-compute[74080]:   <memoryBacking supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:     <enum name='sourceType'>
Oct 16 07:24:15 user nova-compute[74080]:       <value>file</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>anonymous</value>
Oct 16 07:24:15 user nova-compute[74080]:       <value>memfd</value>
Oct 16 07:24:15 user nova-compute[74080]:     </enum>
Oct 16 07:24:15 user nova-compute[74080]:   </memoryBacking>
Oct 16 07:24:15 user nova-compute[74080]:   <devices>
Oct 16 07:24:15 user nova-compute[74080]:     <disk supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='diskDevice'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>disk</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cdrom</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>floppy</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>lun</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='bus'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>fdc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sata</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </disk>
Oct 16 07:24:15 user nova-compute[74080]:     <graphics supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='type'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>sdl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vnc</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>spice</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egl-headless</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </graphics>
Oct 16 07:24:15 user nova-compute[74080]:     <video supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='modelType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>cirrus</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>vmvga</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>qxl</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>none</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>bochs</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>ramfb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </video>
Oct 16 07:24:15 user nova-compute[74080]:     <hostdev supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='mode'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>subsystem</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='startupPolicy'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>default</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>mandatory</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>requisite</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>optional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='subsysType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>usb</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>pci</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>scsi</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='capsType'/>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='pciBackend'/>
Oct 16 07:24:15 user nova-compute[74080]:     </hostdev>
Oct 16 07:24:15 user nova-compute[74080]:     <rng supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtio-non-transitional</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>random</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>egd</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>builtin</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </rng>
Oct 16 07:24:15 user nova-compute[74080]:     <filesystem supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='driverType'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>path</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>handle</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>virtiofs</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </filesystem>
Oct 16 07:24:15 user nova-compute[74080]:     <tpm supported='yes'>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='model'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-tis</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>tpm-crb</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:       <enum name='backendModel'>
Oct 16 07:24:15 user nova-compute[74080]:         <value>passthrough</value>
Oct 16 07:24:15 user nova-compute[74080]:         <value>emulator</value>
Oct 16 07:24:15 user nova-compute[74080]:       </enum>
Oct 16 07:24:15 user nova-compute[74080]:     </tpm>
Oct 16 07:24:15 user nova-compute[74080]:   </devices>
Oct 16 07:24:15 user nova-compute[74080]:   <features>
Oct 16 07:24:15 user nova-compute[74080]:     <gic supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:     <vmcoreinfo supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <genid supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backingStoreInput supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <backup supported='yes'/>
Oct 16 07:24:15 user nova-compute[74080]:     <sev supported='no'/>
Oct 16 07:24:15 user nova-compute[74080]:   </features>
Oct 16 07:24:15 user nova-compute[74080]: </domainCapabilities>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74080) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74080) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74080) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74080) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74080) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 07:24:15 user nova-compute[74080]: INFO nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Secure Boot support detected
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] cpu compare xml: <cpu match="exact">
Oct 16 07:24:15 user nova-compute[74080]:   <model>Nehalem</model>
Oct 16 07:24:15 user nova-compute[74080]: </cpu>
Oct 16 07:24:15 user nova-compute[74080]:  {{(pid=74080) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 16 07:24:15 user nova-compute[74080]: INFO nova.virt.node [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Generated node identity b5aa9fe6-2f98-4919-84cb-476610cf1fc7
Oct 16 07:24:15 user nova-compute[74080]: INFO nova.virt.node [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Wrote node identity b5aa9fe6-2f98-4919-84cb-476610cf1fc7 to /opt/stack/data/nova/compute_id
Oct 16 07:24:15 user nova-compute[74080]: WARNING nova.compute.manager [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Compute nodes ['b5aa9fe6-2f98-4919-84cb-476610cf1fc7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 16 07:24:15 user nova-compute[74080]: INFO nova.compute.manager [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 16 07:24:15 user nova-compute[74080]: WARNING nova.compute.manager [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 07:24:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:24:15 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:24:15 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Hypervisor/Node resource view: name=user free_ram=10926MB free_disk=26.17184066772461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:24:15 user nova-compute[74080]: WARNING nova.compute.resource_tracker [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] No compute node record for user:b5aa9fe6-2f98-4919-84cb-476610cf1fc7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b5aa9fe6-2f98-4919-84cb-476610cf1fc7 could not be found.
Oct 16 07:24:15 user nova-compute[74080]: INFO nova.compute.resource_tracker [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Compute node record created for user:user with uuid: b5aa9fe6-2f98-4919-84cb-476610cf1fc7
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:24:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:24:16 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] [req-4c7c40c4-a325-4247-85c7-7d14fd12922e] Created resource provider record via placement API for resource provider with UUID b5aa9fe6-2f98-4919-84cb-476610cf1fc7 and name user.
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74080) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 16 07:24:16 user nova-compute[74080]: INFO nova.virt.libvirt.host [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] kernel doesn't support AMD SEV
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Updating inventory in ProviderTree for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Libvirt baseline CPU <cpu>
Oct 16 07:24:16 user nova-compute[74080]:   <arch>x86_64</arch>
Oct 16 07:24:16 user nova-compute[74080]:   <model>Nehalem</model>
Oct 16 07:24:16 user nova-compute[74080]:   <vendor>Intel</vendor>
Oct 16 07:24:16 user nova-compute[74080]:   <topology sockets="6" cores="1" threads="1"/>
Oct 16 07:24:16 user nova-compute[74080]: </cpu>
Oct 16 07:24:16 user nova-compute[74080]:  {{(pid=74080) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Updated inventory for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Updating resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 generation from 0 to 1 during operation: update_inventory {{(pid=74080) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Updating inventory in ProviderTree for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Updating resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 generation from 1 to 2 during operation: update_traits {{(pid=74080) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.service [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Creating RPC server for service compute {{(pid=74080) start /opt/stack/nova/nova/service.py:182}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.service [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] Join ServiceGroup membership for this service compute {{(pid=74080) start /opt/stack/nova/nova/service.py:199}}
Oct 16 07:24:16 user nova-compute[74080]: DEBUG nova.servicegroup.drivers.db [None req-6dfa20fb-c40f-408b-aa78-a9bf661ea6e9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74080) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 16 07:25:01 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:01 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Didn't find any instances for network info cache update. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:25:07 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:25:07 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=10377MB free_disk=26.07550048828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:25:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:26:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Didn't find any instances for network info cache update. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:26:09 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:26:09 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:26:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=10296MB free_disk=26.128692626953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:26:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:27:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:27:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:27:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Didn't find any instances for network info cache update. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 07:27:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:27:09 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:27:09 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:27:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=10326MB free_disk=25.89321517944336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:27:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:27:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:27:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Didn't find any instances for network info cache update. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:28:09 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:09 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=9585MB free_disk=25.912940979003906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:28:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:28:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:15 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:28:16 user nova-compute[74080]: INFO nova.compute.claims [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Claim successful on node user
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:28:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:28:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Creating image(s)
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "/opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "/opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:17 user nova-compute[74080]: DEBUG nova.policy [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e57df7c833849328ba240aa1ce74a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b292828eb6e14986b6a0d34b1d556c08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:28:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.part --force-share --output=json" returned: 0 in 0.242s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG nova.virt.images [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] f8d6ec0a-e025-4b3f-8896-9e692aff07e8 was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.part /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.part /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.converted" returned: 0 in 0.269s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.817s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:18 user nova-compute[74080]: INFO oslo.privsep.daemon [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp27r7qlfa/privsep.sock']
Oct 16 07:28:18 user sudo[83518]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp27r7qlfa/privsep.sock
Oct 16 07:28:18 user sudo[83518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 07:28:18 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Successfully created port: a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:28:20 user sudo[83518]: pam_unix(sudo:session): session closed for user root
Oct 16 07:28:20 user nova-compute[74080]: INFO oslo.privsep.daemon [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Spawned new privsep daemon via rootwrap
Oct 16 07:28:20 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 07:28:20 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 07:28:20 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 16 07:28:20 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83524
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.233s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk 1073741824" returned: 0 in 0.053s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:28:21 user nova-compute[74080]: INFO nova.compute.claims [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Claim successful on node user
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Cannot resize image /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Ensure instance console log exists: /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:28:21 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.policy [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bba0d0c7a2d4fb3a757aa0abdfa1a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0746934362024577ae7fd2846d1c2ec7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:28:21 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Creating image(s)
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Successfully updated port: a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquired lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.226s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk 1073741824" returned: 0 in 0.052s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received event network-changed-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Refreshing instance network info cache due to event network-changed-a39c6a94-feb8-46ca-9b49-195ba8b75d91. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] Acquiring lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.218s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Cannot resize image /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Ensure instance console log exists: /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:28:23 user nova-compute[74080]: INFO nova.compute.claims [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Claim successful on node user
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:28:23 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Successfully created port: 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updating instance_info_cache with network_info: [{"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Releasing lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Instance network_info: |[{"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] Acquired lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Refreshing network info cache for port a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Start _get_guest_xml network_info=[{"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:28:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:28:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-505035985',display_name='tempest-DeleteServersTestJSON-server-505035985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-505035985',id=1,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b292828eb6e14986b6a0d34b1d556c08',ramdisk_id='',reservation_id='r-apqgqfa5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1269385163',owner_user_name='tempest-DeleteServersTestJSON-1269385163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:17Z,user_data=None,user_id='8e57df7c833849328ba240aa1ce74a68',uuid=9ca2ec50-7468-41d7-9bab-5021f4875604,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Converting VIF {"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:2a,bridge_name='br-int',has_traffic_filtering=True,id=a39c6a94-feb8-46ca-9b49-195ba8b75d91,network=Network(8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39c6a94-fe') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.objects.instance [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ca2ec50-7468-41d7-9bab-5021f4875604 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:28:24 user nova-compute[74080]:   <uuid>9ca2ec50-7468-41d7-9bab-5021f4875604</uuid>
Oct 16 07:28:24 user nova-compute[74080]:   <name>instance-00000001</name>
Oct 16 07:28:24 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:28:24 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:28:24 user nova-compute[74080]:   <metadata>
Oct 16 07:28:24 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:28:24 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:28:24 user nova-compute[74080]:       <nova:name>tempest-DeleteServersTestJSON-server-505035985</nova:name>
Oct 16 07:28:24 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:28:23</nova:creationTime>
Oct 16 07:28:24 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:28:24 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:28:24 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:28:24 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:28:24 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:28:24 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:28:24 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:28:24 user nova-compute[74080]:       <nova:owner>
Oct 16 07:28:24 user nova-compute[74080]:         <nova:user uuid="8e57df7c833849328ba240aa1ce74a68">tempest-DeleteServersTestJSON-1269385163-project-member</nova:user>
Oct 16 07:28:24 user nova-compute[74080]:         <nova:project uuid="b292828eb6e14986b6a0d34b1d556c08">tempest-DeleteServersTestJSON-1269385163</nova:project>
Oct 16 07:28:24 user nova-compute[74080]:       </nova:owner>
Oct 16 07:28:24 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:28:24 user nova-compute[74080]:       <nova:ports>
Oct 16 07:28:24 user nova-compute[74080]:         <nova:port uuid="a39c6a94-feb8-46ca-9b49-195ba8b75d91">
Oct 16 07:28:24 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 07:28:24 user nova-compute[74080]:         </nova:port>
Oct 16 07:28:24 user nova-compute[74080]:       </nova:ports>
Oct 16 07:28:24 user nova-compute[74080]:     </nova:instance>
Oct 16 07:28:24 user nova-compute[74080]:   </metadata>
Oct 16 07:28:24 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:28:24 user nova-compute[74080]:     <system>
Oct 16 07:28:24 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:28:24 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:28:24 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:28:24 user nova-compute[74080]:       <entry name="serial">9ca2ec50-7468-41d7-9bab-5021f4875604</entry>
Oct 16 07:28:24 user nova-compute[74080]:       <entry name="uuid">9ca2ec50-7468-41d7-9bab-5021f4875604</entry>
Oct 16 07:28:24 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:28:24 user nova-compute[74080]:     </system>
Oct 16 07:28:24 user nova-compute[74080]:   </sysinfo>
Oct 16 07:28:24 user nova-compute[74080]:   <os>
Oct 16 07:28:24 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:28:24 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:28:24 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:28:24 user nova-compute[74080]:   </os>
Oct 16 07:28:24 user nova-compute[74080]:   <features>
Oct 16 07:28:24 user nova-compute[74080]:     <acpi/>
Oct 16 07:28:24 user nova-compute[74080]:     <apic/>
Oct 16 07:28:24 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:28:24 user nova-compute[74080]:   </features>
Oct 16 07:28:24 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:28:24 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:28:24 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:28:24 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:28:24 user nova-compute[74080]:   </clock>
Oct 16 07:28:24 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:28:24 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:28:24 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:28:24 user nova-compute[74080]:   </cpu>
Oct 16 07:28:24 user nova-compute[74080]:   <devices>
Oct 16 07:28:24 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:28:24 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:28:24 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk"/>
Oct 16 07:28:24 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:28:24 user nova-compute[74080]:     </disk>
Oct 16 07:28:24 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:28:24 user nova-compute[74080]:       <mac address="fa:16:3e:cc:e0:2a"/>
Oct 16 07:28:24 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:24 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:28:24 user nova-compute[74080]:       <target dev="tapa39c6a94-fe"/>
Oct 16 07:28:24 user nova-compute[74080]:     </interface>
Oct 16 07:28:24 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:28:24 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/console.log" append="off"/>
Oct 16 07:28:24 user nova-compute[74080]:     </serial>
Oct 16 07:28:24 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:28:24 user nova-compute[74080]:     <video>
Oct 16 07:28:24 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:24 user nova-compute[74080]:     </video>
Oct 16 07:28:24 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:28:24 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:28:24 user nova-compute[74080]:     </rng>
Oct 16 07:28:24 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:28:24 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:28:24 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:28:24 user nova-compute[74080]:     </memballoon>
Oct 16 07:28:24 user nova-compute[74080]:   </devices>
Oct 16 07:28:24 user nova-compute[74080]: </domain>
Oct 16 07:28:24 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-505035985',display_name='tempest-DeleteServersTestJSON-server-505035985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-505035985',id=1,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b292828eb6e14986b6a0d34b1d556c08',ramdisk_id='',reservation_id='r-apqgqfa5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1269385163',owner_user_name='tempest-DeleteServersTestJSON-1269385163-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:17Z,user_data=None,user_id='8e57df7c833849328ba240aa1ce74a68',uuid=9ca2ec50-7468-41d7-9bab-5021f4875604,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Converting VIF {"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:2a,bridge_name='br-int',has_traffic_filtering=True,id=a39c6a94-feb8-46ca-9b49-195ba8b75d91,network=Network(8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39c6a94-fe') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG os_vif [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:2a,bridge_name='br-int',has_traffic_filtering=True,id=a39c6a94-feb8-46ca-9b49-195ba8b75d91,network=Network(8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39c6a94-fe') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Created schema index Interface.name {{(pid=74080) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Created schema index Port.name {{(pid=74080) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Created schema index Bridge.name {{(pid=74080) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [POLLOUT] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:28:24 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Creating image(s)
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eeada0cb-4649-5809-93d7-562e2bea7180', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:24 user nova-compute[74080]: INFO oslo.privsep.daemon [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpbby7mnpt/privsep.sock']
Oct 16 07:28:24 user sudo[83574]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpbby7mnpt/privsep.sock
Oct 16 07:28:24 user sudo[83574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.policy [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbfbcc052d274a2b85276bf7c12e8233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998dad27b18a4a15a4563815aa57cb72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk 1073741824" returned: 0 in 0.047s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:28:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Cannot resize image /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Ensure instance console log exists: /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:25 user sudo[83574]: pam_unix(sudo:session): session closed for user root
Oct 16 07:28:25 user nova-compute[74080]: INFO oslo.privsep.daemon [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Spawned new privsep daemon via rootwrap
Oct 16 07:28:25 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 07:28:25 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 07:28:25 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 16 07:28:25 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83594
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.network.neutron [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Successfully updated port: 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.network.neutron [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.network.neutron [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa39c6a94-fe, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa39c6a94-fe, col_values=(('qos', UUID('a9b498a7-5a06-4c94-959e-2c4c11b2e84c')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa39c6a94-fe, col_values=(('external_ids', {'iface-id': 'a39c6a94-feb8-46ca-9b49-195ba8b75d91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:e0:2a', 'vm-uuid': '9ca2ec50-7468-41d7-9bab-5021f4875604'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:26 user nova-compute[74080]: INFO os_vif [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:e0:2a,bridge_name='br-int',has_traffic_filtering=True,id=a39c6a94-feb8-46ca-9b49-195ba8b75d91,network=Network(8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39c6a94-fe')
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] No VIF found with MAC fa:16:3e:cc:e0:2a, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-changed-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Refreshing instance network info cache due to event network-changed-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updated VIF entry in instance network info cache for port a39c6a94-feb8-46ca-9b49-195ba8b75d91. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updating instance_info_cache with network_info: [{"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7d74a25d-6910-4275-8c66-6557348f7354 req-b31764b8-66bb-4f18-b52f-46003de3d9c1 service nova] Releasing lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.network.neutron [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance network_info: |[{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Refreshing network info cache for port 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Start _get_guest_xml network_info=[{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:28:26 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:26 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:28:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.objects.instance [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lazy-loading 'pci_devices' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:28:27 user nova-compute[74080]:   <uuid>e4b3aaca-821e-410f-83c1-7287a48c7723</uuid>
Oct 16 07:28:27 user nova-compute[74080]:   <name>instance-00000002</name>
Oct 16 07:28:27 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:28:27 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:28:27 user nova-compute[74080]:   <metadata>
Oct 16 07:28:27 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:28:27 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:28:27 user nova-compute[74080]:       <nova:name>tempest-ServerActionsTestOtherB-server-1311694320</nova:name>
Oct 16 07:28:27 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:28:26</nova:creationTime>
Oct 16 07:28:27 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:28:27 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:28:27 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:28:27 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:28:27 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:28:27 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:28:27 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:28:27 user nova-compute[74080]:       <nova:owner>
Oct 16 07:28:27 user nova-compute[74080]:         <nova:user uuid="5bba0d0c7a2d4fb3a757aa0abdfa1a2e">tempest-ServerActionsTestOtherB-885127344-project-member</nova:user>
Oct 16 07:28:27 user nova-compute[74080]:         <nova:project uuid="0746934362024577ae7fd2846d1c2ec7">tempest-ServerActionsTestOtherB-885127344</nova:project>
Oct 16 07:28:27 user nova-compute[74080]:       </nova:owner>
Oct 16 07:28:27 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:28:27 user nova-compute[74080]:       <nova:ports>
Oct 16 07:28:27 user nova-compute[74080]:         <nova:port uuid="1184cb83-61e9-4582-9ff1-1a62d2e9f4a4">
Oct 16 07:28:27 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:28:27 user nova-compute[74080]:         </nova:port>
Oct 16 07:28:27 user nova-compute[74080]:       </nova:ports>
Oct 16 07:28:27 user nova-compute[74080]:     </nova:instance>
Oct 16 07:28:27 user nova-compute[74080]:   </metadata>
Oct 16 07:28:27 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:28:27 user nova-compute[74080]:     <system>
Oct 16 07:28:27 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:28:27 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:28:27 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:28:27 user nova-compute[74080]:       <entry name="serial">e4b3aaca-821e-410f-83c1-7287a48c7723</entry>
Oct 16 07:28:27 user nova-compute[74080]:       <entry name="uuid">e4b3aaca-821e-410f-83c1-7287a48c7723</entry>
Oct 16 07:28:27 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:28:27 user nova-compute[74080]:     </system>
Oct 16 07:28:27 user nova-compute[74080]:   </sysinfo>
Oct 16 07:28:27 user nova-compute[74080]:   <os>
Oct 16 07:28:27 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:28:27 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:28:27 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:28:27 user nova-compute[74080]:   </os>
Oct 16 07:28:27 user nova-compute[74080]:   <features>
Oct 16 07:28:27 user nova-compute[74080]:     <acpi/>
Oct 16 07:28:27 user nova-compute[74080]:     <apic/>
Oct 16 07:28:27 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:28:27 user nova-compute[74080]:   </features>
Oct 16 07:28:27 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:28:27 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:28:27 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:28:27 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:28:27 user nova-compute[74080]:   </clock>
Oct 16 07:28:27 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:28:27 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:28:27 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:28:27 user nova-compute[74080]:   </cpu>
Oct 16 07:28:27 user nova-compute[74080]:   <devices>
Oct 16 07:28:27 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:28:27 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:28:27 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk"/>
Oct 16 07:28:27 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:28:27 user nova-compute[74080]:     </disk>
Oct 16 07:28:27 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:28:27 user nova-compute[74080]:       <mac address="fa:16:3e:29:3d:72"/>
Oct 16 07:28:27 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:27 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:28:27 user nova-compute[74080]:       <target dev="tap1184cb83-61"/>
Oct 16 07:28:27 user nova-compute[74080]:     </interface>
Oct 16 07:28:27 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:28:27 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/console.log" append="off"/>
Oct 16 07:28:27 user nova-compute[74080]:     </serial>
Oct 16 07:28:27 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:28:27 user nova-compute[74080]:     <video>
Oct 16 07:28:27 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:27 user nova-compute[74080]:     </video>
Oct 16 07:28:27 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:28:27 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:28:27 user nova-compute[74080]:     </rng>
Oct 16 07:28:27 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:28:27 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:28:27 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:28:27 user nova-compute[74080]:     </memballoon>
Oct 16 07:28:27 user nova-compute[74080]:   </devices>
Oct 16 07:28:27 user nova-compute[74080]: </domain>
Oct 16 07:28:27 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG os_vif [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45442e9b-be3e-5f95-8bbe-c9eede3e2487', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1184cb83-61, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1184cb83-61, col_values=(('qos', UUID('3b22287b-6175-4dab-a158-1c76b28c9091')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1184cb83-61, col_values=(('external_ids', {'iface-id': '1184cb83-61e9-4582-9ff1-1a62d2e9f4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:3d:72', 'vm-uuid': 'e4b3aaca-821e-410f-83c1-7287a48c7723'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:27 user nova-compute[74080]: INFO os_vif [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61')
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No VIF found with MAC fa:16:3e:29:3d:72, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:28:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updated VIF entry in instance network info cache for port 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a8095680-5d96-40ec-997a-cb6db124c321 req-879c6c31-8157-49fa-ba8b-67d9dd9dcbe5 service nova] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG nova.network.neutron [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Successfully created port: 8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:28:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:28:31 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Instance spawned successfully.
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: INFO nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Took 14.56 seconds to spawn the instance on the hypervisor.
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:28:31 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance spawned successfully.
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:31 user nova-compute[74080]: INFO nova.compute.manager [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Took 15.98 seconds to build instance.
Oct 16 07:28:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c2908c55-2afb-4896-8ecf-b66b6d889d85 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.248s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:31 user nova-compute[74080]: INFO nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Took 10.25 seconds to spawn the instance on the hypervisor.
Oct 16 07:28:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG nova.network.neutron [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Successfully updated port: 8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquired lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG nova.network.neutron [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-changed-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Refreshing instance network info cache due to event network-changed-8165e494-572c-4bae-9f3b-da85a6f9c676. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] Acquiring lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:32 user nova-compute[74080]: INFO nova.compute.manager [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Took 11.20 seconds to build instance.
Oct 16 07:28:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-012893d0-04b4-44b5-874f-c5d7922212e1 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.566s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:32 user nova-compute[74080]: DEBUG nova.network.neutron [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updating instance_info_cache with network_info: [{"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Releasing lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Instance network_info: |[{"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] Acquired lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.network.neutron [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Refreshing network info cache for port 8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Start _get_guest_xml network_info=[{"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:28:33 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:33 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1462507476',display_name='tempest-AttachVolumeNegativeTest-server-1462507476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1462507476',id=3,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxrIrWWqawGXVR0rf/6sQvLx8mT2Qhh/8rM4LMRnJ1KOQSg5NZgHwE4Fqe4jkv0EMMnky9Eqrt14KZ5PSTCuRiPdMY4RMXJmAXW0wrl1f2KiAhndX/jAq4gkQ8buVky+g==',key_name='tempest-keypair-1529714285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-4s0gqh7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b7:32,bridge_name='br-int',has_traffic_filtering=True,id=8165e494-572c-4bae-9f3b-da85a6f9c676,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8165e494-57') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.objects.instance [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:28:33 user nova-compute[74080]:   <uuid>8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4</uuid>
Oct 16 07:28:33 user nova-compute[74080]:   <name>instance-00000003</name>
Oct 16 07:28:33 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:28:33 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:28:33 user nova-compute[74080]:   <metadata>
Oct 16 07:28:33 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:28:33 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:28:33 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1462507476</nova:name>
Oct 16 07:28:33 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:28:33</nova:creationTime>
Oct 16 07:28:33 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:28:33 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:28:33 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:28:33 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:28:33 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:28:33 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:28:33 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:28:33 user nova-compute[74080]:       <nova:owner>
Oct 16 07:28:33 user nova-compute[74080]:         <nova:user uuid="bbfbcc052d274a2b85276bf7c12e8233">tempest-AttachVolumeNegativeTest-1751015165-project-member</nova:user>
Oct 16 07:28:33 user nova-compute[74080]:         <nova:project uuid="998dad27b18a4a15a4563815aa57cb72">tempest-AttachVolumeNegativeTest-1751015165</nova:project>
Oct 16 07:28:33 user nova-compute[74080]:       </nova:owner>
Oct 16 07:28:33 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:28:33 user nova-compute[74080]:       <nova:ports>
Oct 16 07:28:33 user nova-compute[74080]:         <nova:port uuid="8165e494-572c-4bae-9f3b-da85a6f9c676">
Oct 16 07:28:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:28:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:28:33 user nova-compute[74080]:       </nova:ports>
Oct 16 07:28:33 user nova-compute[74080]:     </nova:instance>
Oct 16 07:28:33 user nova-compute[74080]:   </metadata>
Oct 16 07:28:33 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:28:33 user nova-compute[74080]:     <system>
Oct 16 07:28:33 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:28:33 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:28:33 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:28:33 user nova-compute[74080]:       <entry name="serial">8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4</entry>
Oct 16 07:28:33 user nova-compute[74080]:       <entry name="uuid">8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4</entry>
Oct 16 07:28:33 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:28:33 user nova-compute[74080]:     </system>
Oct 16 07:28:33 user nova-compute[74080]:   </sysinfo>
Oct 16 07:28:33 user nova-compute[74080]:   <os>
Oct 16 07:28:33 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:28:33 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:28:33 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:28:33 user nova-compute[74080]:   </os>
Oct 16 07:28:33 user nova-compute[74080]:   <features>
Oct 16 07:28:33 user nova-compute[74080]:     <acpi/>
Oct 16 07:28:33 user nova-compute[74080]:     <apic/>
Oct 16 07:28:33 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:28:33 user nova-compute[74080]:   </features>
Oct 16 07:28:33 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:28:33 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:28:33 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:28:33 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:28:33 user nova-compute[74080]:   </clock>
Oct 16 07:28:33 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:28:33 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:28:33 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:28:33 user nova-compute[74080]:   </cpu>
Oct 16 07:28:33 user nova-compute[74080]:   <devices>
Oct 16 07:28:33 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:28:33 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:28:33 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk"/>
Oct 16 07:28:33 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:28:33 user nova-compute[74080]:     </disk>
Oct 16 07:28:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:28:33 user nova-compute[74080]:       <mac address="fa:16:3e:24:b7:32"/>
Oct 16 07:28:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:28:33 user nova-compute[74080]:       <target dev="tap8165e494-57"/>
Oct 16 07:28:33 user nova-compute[74080]:     </interface>
Oct 16 07:28:33 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:28:33 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/console.log" append="off"/>
Oct 16 07:28:33 user nova-compute[74080]:     </serial>
Oct 16 07:28:33 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:28:33 user nova-compute[74080]:     <video>
Oct 16 07:28:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:33 user nova-compute[74080]:     </video>
Oct 16 07:28:33 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:28:33 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:28:33 user nova-compute[74080]:     </rng>
Oct 16 07:28:33 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:28:33 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:28:33 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:28:33 user nova-compute[74080]:     </memballoon>
Oct 16 07:28:33 user nova-compute[74080]:   </devices>
Oct 16 07:28:33 user nova-compute[74080]: </domain>
Oct 16 07:28:33 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1462507476',display_name='tempest-AttachVolumeNegativeTest-server-1462507476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1462507476',id=3,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxrIrWWqawGXVR0rf/6sQvLx8mT2Qhh/8rM4LMRnJ1KOQSg5NZgHwE4Fqe4jkv0EMMnky9Eqrt14KZ5PSTCuRiPdMY4RMXJmAXW0wrl1f2KiAhndX/jAq4gkQ8buVky+g==',key_name='tempest-keypair-1529714285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-4s0gqh7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:b7:32,bridge_name='br-int',has_traffic_filtering=True,id=8165e494-572c-4bae-9f3b-da85a6f9c676,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8165e494-57') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG os_vif [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b7:32,bridge_name='br-int',has_traffic_filtering=True,id=8165e494-572c-4bae-9f3b-da85a6f9c676,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8165e494-57') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cab4be1d-884b-558c-8866-7d5f0f04d7f2', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8165e494-57, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8165e494-57, col_values=(('qos', UUID('f2071304-f3c4-4fc5-960e-f0f220aab2fd')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8165e494-57, col_values=(('external_ids', {'iface-id': '8165e494-572c-4bae-9f3b-da85a6f9c676', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:b7:32', 'vm-uuid': '8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:34 user nova-compute[74080]: INFO os_vif [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:b7:32,bridge_name='br-int',has_traffic_filtering=True,id=8165e494-572c-4bae-9f3b-da85a6f9c676,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8165e494-57')
Oct 16 07:28:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No VIF found with MAC fa:16:3e:24:b7:32, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-3598574d-1aba-46db-9d43-c6c32e3ffb68 req-acbeab67-af47-48ea-ae73-cbc75d441ca7 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received event network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3598574d-1aba-46db-9d43-c6c32e3ffb68 req-acbeab67-af47-48ea-ae73-cbc75d441ca7 service nova] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3598574d-1aba-46db-9d43-c6c32e3ffb68 req-acbeab67-af47-48ea-ae73-cbc75d441ca7 service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3598574d-1aba-46db-9d43-c6c32e3ffb68 req-acbeab67-af47-48ea-ae73-cbc75d441ca7 service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-3598574d-1aba-46db-9d43-c6c32e3ffb68 req-acbeab67-af47-48ea-ae73-cbc75d441ca7 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] No waiting events found dispatching network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:34 user nova-compute[74080]: WARNING nova.compute.manager [req-3598574d-1aba-46db-9d43-c6c32e3ffb68 req-acbeab67-af47-48ea-ae73-cbc75d441ca7 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received unexpected event network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 for instance with vm_state active and task_state None.
Oct 16 07:28:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updated VIF entry in instance network info cache for port 8165e494-572c-4bae-9f3b-da85a6f9c676. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updating instance_info_cache with network_info: [{"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd96ea29-1578-4a0a-9b36-36d13fbbc642 req-da3f2fdd-1c8d-4086-b60f-2f0200fc4ea0 service nova] Releasing lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-60cf7b6d-52b5-4978-819d-19b7b33c16dc req-4817d064-412e-4166-b582-93b89173d50a service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received event network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-60cf7b6d-52b5-4978-819d-19b7b33c16dc req-4817d064-412e-4166-b582-93b89173d50a service nova] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-60cf7b6d-52b5-4978-819d-19b7b33c16dc req-4817d064-412e-4166-b582-93b89173d50a service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-60cf7b6d-52b5-4978-819d-19b7b33c16dc req-4817d064-412e-4166-b582-93b89173d50a service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-60cf7b6d-52b5-4978-819d-19b7b33c16dc req-4817d064-412e-4166-b582-93b89173d50a service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] No waiting events found dispatching network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:36 user nova-compute[74080]: WARNING nova.compute.manager [req-60cf7b6d-52b5-4978-819d-19b7b33c16dc req-4817d064-412e-4166-b582-93b89173d50a service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received unexpected event network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 for instance with vm_state active and task_state None.
Oct 16 07:28:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:28:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Instance spawned successfully.
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:39 user nova-compute[74080]: INFO nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Took 14.92 seconds to spawn the instance on the hypervisor.
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:39 user nova-compute[74080]: INFO nova.compute.manager [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Took 15.93 seconds to build instance.
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-470c0727-92f9-4af5-b496-d3a3f78571a2 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.068s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:28:39 user nova-compute[74080]: INFO nova.compute.claims [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Claim successful on node user
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:28:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:28:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:28:40 user nova-compute[74080]: DEBUG nova.policy [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb8d2a523034e03b8bb5f09d5f720fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2464ccb4f24e319dadbd7d2edd64fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:28:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Creating image(s)
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "/opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "/opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "/opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.248s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.271s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk 1073741824" returned: 0 in 0.105s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.383s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.290s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Cannot resize image /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Ensure instance console log exists: /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:41 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Successfully created port: f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:28:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Successfully updated port: f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquired lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-changed-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Refreshing instance network info cache due to event network-changed-f4208389-c89e-435b-8e7f-e34473a939b6. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] Acquiring lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating instance_info_cache with network_info: [{"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Releasing lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Instance network_info: |[{"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] Acquired lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Refreshing network info cache for port f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Start _get_guest_xml network_info=[{"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:28:44 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:44 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1210249820',display_name='tempest-VolumesAdminNegativeTest-server-1210249820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1210249820',id=4,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM431sxIeG1W5nsrrRP4bvADO4ODSlunmy/dbTolxODslXIeyQ3iWCAXetOVVtsKA3kaXZcLwG2kYME10XXHuqAglUZzPbJ37lkEG4EhD6kC3LSoZB3JZ6Z8MEoZXZsYw==',key_name='tempest-keypair-551139216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2464ccb4f24e319dadbd7d2edd64fd',ramdisk_id='',reservation_id='r-sqeogjpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1570382741',owner_user_name='tempest-VolumesAdminNegativeTest-1570382741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb8d2a523034e03b8bb5f09d5f720fa',uuid=f055134f-7d13-4ee6-9dfa-11207791a674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converting VIF {"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:99:04,bridge_name='br-int',has_traffic_filtering=True,id=f4208389-c89e-435b-8e7f-e34473a939b6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4208389-c8') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.objects.instance [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lazy-loading 'pci_devices' on Instance uuid f055134f-7d13-4ee6-9dfa-11207791a674 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:28:44 user nova-compute[74080]:   <uuid>f055134f-7d13-4ee6-9dfa-11207791a674</uuid>
Oct 16 07:28:44 user nova-compute[74080]:   <name>instance-00000004</name>
Oct 16 07:28:44 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:28:44 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:28:44 user nova-compute[74080]:   <metadata>
Oct 16 07:28:44 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:28:44 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:28:44 user nova-compute[74080]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1210249820</nova:name>
Oct 16 07:28:44 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:28:44</nova:creationTime>
Oct 16 07:28:44 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:28:44 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:28:44 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:28:44 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:28:44 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:28:44 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:28:44 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:28:44 user nova-compute[74080]:       <nova:owner>
Oct 16 07:28:44 user nova-compute[74080]:         <nova:user uuid="ebb8d2a523034e03b8bb5f09d5f720fa">tempest-VolumesAdminNegativeTest-1570382741-project-member</nova:user>
Oct 16 07:28:44 user nova-compute[74080]:         <nova:project uuid="5c2464ccb4f24e319dadbd7d2edd64fd">tempest-VolumesAdminNegativeTest-1570382741</nova:project>
Oct 16 07:28:44 user nova-compute[74080]:       </nova:owner>
Oct 16 07:28:44 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:28:44 user nova-compute[74080]:       <nova:ports>
Oct 16 07:28:44 user nova-compute[74080]:         <nova:port uuid="f4208389-c89e-435b-8e7f-e34473a939b6">
Oct 16 07:28:44 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:28:44 user nova-compute[74080]:         </nova:port>
Oct 16 07:28:44 user nova-compute[74080]:       </nova:ports>
Oct 16 07:28:44 user nova-compute[74080]:     </nova:instance>
Oct 16 07:28:44 user nova-compute[74080]:   </metadata>
Oct 16 07:28:44 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:28:44 user nova-compute[74080]:     <system>
Oct 16 07:28:44 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:28:44 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:28:44 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:28:44 user nova-compute[74080]:       <entry name="serial">f055134f-7d13-4ee6-9dfa-11207791a674</entry>
Oct 16 07:28:44 user nova-compute[74080]:       <entry name="uuid">f055134f-7d13-4ee6-9dfa-11207791a674</entry>
Oct 16 07:28:44 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:28:44 user nova-compute[74080]:     </system>
Oct 16 07:28:44 user nova-compute[74080]:   </sysinfo>
Oct 16 07:28:44 user nova-compute[74080]:   <os>
Oct 16 07:28:44 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:28:44 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:28:44 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:28:44 user nova-compute[74080]:   </os>
Oct 16 07:28:44 user nova-compute[74080]:   <features>
Oct 16 07:28:44 user nova-compute[74080]:     <acpi/>
Oct 16 07:28:44 user nova-compute[74080]:     <apic/>
Oct 16 07:28:44 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:28:44 user nova-compute[74080]:   </features>
Oct 16 07:28:44 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:28:44 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:28:44 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:28:44 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:28:44 user nova-compute[74080]:   </clock>
Oct 16 07:28:44 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:28:44 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:28:44 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:28:44 user nova-compute[74080]:   </cpu>
Oct 16 07:28:44 user nova-compute[74080]:   <devices>
Oct 16 07:28:44 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:28:44 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:28:44 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk"/>
Oct 16 07:28:44 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:28:44 user nova-compute[74080]:     </disk>
Oct 16 07:28:44 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:28:44 user nova-compute[74080]:       <mac address="fa:16:3e:aa:99:04"/>
Oct 16 07:28:44 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:44 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:28:44 user nova-compute[74080]:       <target dev="tapf4208389-c8"/>
Oct 16 07:28:44 user nova-compute[74080]:     </interface>
Oct 16 07:28:44 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:28:44 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/console.log" append="off"/>
Oct 16 07:28:44 user nova-compute[74080]:     </serial>
Oct 16 07:28:44 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:28:44 user nova-compute[74080]:     <video>
Oct 16 07:28:44 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:44 user nova-compute[74080]:     </video>
Oct 16 07:28:44 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:28:44 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:28:44 user nova-compute[74080]:     </rng>
Oct 16 07:28:44 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:28:44 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:28:44 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:28:44 user nova-compute[74080]:     </memballoon>
Oct 16 07:28:44 user nova-compute[74080]:   </devices>
Oct 16 07:28:44 user nova-compute[74080]: </domain>
Oct 16 07:28:44 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1210249820',display_name='tempest-VolumesAdminNegativeTest-server-1210249820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1210249820',id=4,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM431sxIeG1W5nsrrRP4bvADO4ODSlunmy/dbTolxODslXIeyQ3iWCAXetOVVtsKA3kaXZcLwG2kYME10XXHuqAglUZzPbJ37lkEG4EhD6kC3LSoZB3JZ6Z8MEoZXZsYw==',key_name='tempest-keypair-551139216',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2464ccb4f24e319dadbd7d2edd64fd',ramdisk_id='',reservation_id='r-sqeogjpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1570382741',owner_user_name='tempest-VolumesAdminNegativeTest-1570382741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb8d2a523034e03b8bb5f09d5f720fa',uuid=f055134f-7d13-4ee6-9dfa-11207791a674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converting VIF {"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:99:04,bridge_name='br-int',has_traffic_filtering=True,id=f4208389-c89e-435b-8e7f-e34473a939b6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4208389-c8') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG os_vif [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:99:04,bridge_name='br-int',has_traffic_filtering=True,id=f4208389-c89e-435b-8e7f-e34473a939b6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4208389-c8') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3b9db94-477c-5d8a-9722-7c932f080880', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4208389-c8, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4208389-c8, col_values=(('qos', UUID('461997ea-25bb-4f66-a9b9-6ffc7299ce40')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4208389-c8, col_values=(('external_ids', {'iface-id': 'f4208389-c89e-435b-8e7f-e34473a939b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:99:04', 'vm-uuid': 'f055134f-7d13-4ee6-9dfa-11207791a674'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:44 user nova-compute[74080]: INFO os_vif [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:99:04,bridge_name='br-int',has_traffic_filtering=True,id=f4208389-c89e-435b-8e7f-e34473a939b6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4208389-c8')
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] No VIF found with MAC fa:16:3e:aa:99:04, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:28:45 user nova-compute[74080]: INFO nova.compute.claims [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Claim successful on node user
Oct 16 07:28:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG nova.network.neutron [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updated VIF entry in instance network info cache for port f4208389-c89e-435b-8e7f-e34473a939b6. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG nova.network.neutron [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating instance_info_cache with network_info: [{"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-97ee1dd4-78ba-4cde-bae2-9355522c593d req-ff42d1ee-a92e-4f91-898e-42f345abdc67 service nova] Releasing lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:45 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.985s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.727s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:28:46 user nova-compute[74080]: INFO nova.compute.claims [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Claim successful on node user
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:28:46 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.policy [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b60dc9148587426ebd0b15ddb70a3139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c006491b0f449394c55b7024a19bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:28:46 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Creating image(s)
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.259s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:28:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:28:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 16 07:28:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG nova.policy [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99b8cd76ab7a4d68b4f2826dc95e6eb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62034e9a9464aa28d72ba8ae3333c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.348s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:28:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Creating image(s)
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "/opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "/opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "0b4433fda8209832fa7c55ad742dd6c630fc8a43" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "0b4433fda8209832fa7c55ad742dd6c630fc8a43" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk 1073741824" returned: 0 in 0.093s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.445s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:47 user nova-compute[74080]: DEBUG nova.network.neutron [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Successfully created port: 7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Successfully created port: c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.736s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.part --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG nova.virt.images [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] 71d403eb-cb21-41d8-b469-8f26f2b1e23d was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.part /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Cannot resize image /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Ensure instance console log exists: /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.part /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.converted" returned: 0 in 0.480s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43.converted --force-share --output=json" returned: 0 in 0.322s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "0b4433fda8209832fa7c55ad742dd6c630fc8a43" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.751s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43 --force-share --output=json" returned: 0 in 0.206s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "0b4433fda8209832fa7c55ad742dd6c630fc8a43" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "0b4433fda8209832fa7c55ad742dd6c630fc8a43" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Successfully updated port: c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquired lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43 --force-share --output=json" returned: 0 in 0.232s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43,backing_fmt=raw /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Successfully updated port: 7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-changed-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Refreshing instance network info cache due to event network-changed-c9122dc8-4754-4fe0-84cc-9c119964eb16. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] Acquiring lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43,backing_fmt=raw /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk 1073741824" returned: 0 in 0.068s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "0b4433fda8209832fa7c55ad742dd6c630fc8a43" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquired lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-changed-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Refreshing instance network info cache due to event network-changed-7d924de9-0e44-4edf-992f-d94e6d91a876. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] Acquiring lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:28:49 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Instance spawned successfully.
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b4433fda8209832fa7c55ad742dd6c630fc8a43 --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:28:49 user nova-compute[74080]: INFO nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Took 9.48 seconds to spawn the instance on the hypervisor.
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Cannot resize image /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Ensure instance console log exists: /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Updating instance_info_cache with network_info: [{"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:50 user nova-compute[74080]: INFO nova.compute.manager [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Took 10.73 seconds to build instance.
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Releasing lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Instance network_info: |[{"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] Acquired lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Refreshing network info cache for port c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Start _get_guest_xml network_info=[{"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:28:36Z,direct_url=<?>,disk_format='qcow2',id=71d403eb-cb21-41d8-b469-8f26f2b1e23d,min_disk=0,min_ram=0,name='',owner='3b8858581cbd412291285dc0e74bf78e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:28:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/sda', 'image_id': '71d403eb-cb21-41d8-b469-8f26f2b1e23d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:28:50 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:50 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52103c4d-9393-443f-80ad-e533fd3c057f tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.929s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:28:36Z,direct_url=<?>,disk_format='qcow2',id=71d403eb-cb21-41d8-b469-8f26f2b1e23d,min_disk=0,min_ram=0,name='',owner='3b8858581cbd412291285dc0e74bf78e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:28:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1255670706',display_name='tempest-AttachSCSIVolumeTestJSON-server-1255670706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1255670706',id=6,image_ref='71d403eb-cb21-41d8-b469-8f26f2b1e23d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+T/FWygI73lXgVWqpGbqIOsSrVKd6DBPaSaS7IJKbc8ShYsjbebH6l31+26/VHSRbsEe0pD8//STUjYH8Fiq5PQxVHt/oG8SPbmKJSfsSghBJBAOtRUw/gJ9BrS1U8Kw==',key_name='tempest-keypair-1101819471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b62034e9a9464aa28d72ba8ae3333c54',ramdisk_id='',reservation_id='r-im4pyxoi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d403eb-cb21-41d8-b469-8f26f2b1e23d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1829758216',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1829758216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b8cd76ab7a4d68b4f2826dc95e6eb1',uuid=5e0bc1db-0c8e-400b-814c-da5b19e74b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Converting VIF {"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:34,bridge_name='br-int',has_traffic_filtering=True,id=c9122dc8-4754-4fe0-84cc-9c119964eb16,network=Network(ef9c177b-20ca-4797-a4d5-83d83af3ecf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9122dc8-47') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.objects.instance [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e0bc1db-0c8e-400b-814c-da5b19e74b91 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:28:50 user nova-compute[74080]:   <uuid>5e0bc1db-0c8e-400b-814c-da5b19e74b91</uuid>
Oct 16 07:28:50 user nova-compute[74080]:   <name>instance-00000006</name>
Oct 16 07:28:50 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:28:50 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:28:50 user nova-compute[74080]:   <metadata>
Oct 16 07:28:50 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:28:50 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1255670706</nova:name>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:28:50</nova:creationTime>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:28:50 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:28:50 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:owner>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:user uuid="99b8cd76ab7a4d68b4f2826dc95e6eb1">tempest-AttachSCSIVolumeTestJSON-1829758216-project-member</nova:user>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:project uuid="b62034e9a9464aa28d72ba8ae3333c54">tempest-AttachSCSIVolumeTestJSON-1829758216</nova:project>
Oct 16 07:28:50 user nova-compute[74080]:       </nova:owner>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:root type="image" uuid="71d403eb-cb21-41d8-b469-8f26f2b1e23d"/>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:ports>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:port uuid="c9122dc8-4754-4fe0-84cc-9c119964eb16">
Oct 16 07:28:50 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:28:50 user nova-compute[74080]:         </nova:port>
Oct 16 07:28:50 user nova-compute[74080]:       </nova:ports>
Oct 16 07:28:50 user nova-compute[74080]:     </nova:instance>
Oct 16 07:28:50 user nova-compute[74080]:   </metadata>
Oct 16 07:28:50 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:28:50 user nova-compute[74080]:     <system>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="serial">5e0bc1db-0c8e-400b-814c-da5b19e74b91</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="uuid">5e0bc1db-0c8e-400b-814c-da5b19e74b91</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:28:50 user nova-compute[74080]:     </system>
Oct 16 07:28:50 user nova-compute[74080]:   </sysinfo>
Oct 16 07:28:50 user nova-compute[74080]:   <os>
Oct 16 07:28:50 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:28:50 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:28:50 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:28:50 user nova-compute[74080]:   </os>
Oct 16 07:28:50 user nova-compute[74080]:   <features>
Oct 16 07:28:50 user nova-compute[74080]:     <acpi/>
Oct 16 07:28:50 user nova-compute[74080]:     <apic/>
Oct 16 07:28:50 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:28:50 user nova-compute[74080]:   </features>
Oct 16 07:28:50 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:28:50 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:28:50 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:28:50 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:28:50 user nova-compute[74080]:   </clock>
Oct 16 07:28:50 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:28:50 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:28:50 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:28:50 user nova-compute[74080]:   </cpu>
Oct 16 07:28:50 user nova-compute[74080]:   <devices>
Oct 16 07:28:50 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:28:50 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:28:50 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk"/>
Oct 16 07:28:50 user nova-compute[74080]:       <target dev="sda" bus="scsi"/>
Oct 16 07:28:50 user nova-compute[74080]:       <address type="drive" controller="0" unit="0"/>
Oct 16 07:28:50 user nova-compute[74080]:     </disk>
Oct 16 07:28:50 user nova-compute[74080]:     <disk type="file" device="cdrom">
Oct 16 07:28:50 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 07:28:50 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk.config"/>
Oct 16 07:28:50 user nova-compute[74080]:       <target dev="sdb" bus="scsi"/>
Oct 16 07:28:50 user nova-compute[74080]:       <address type="drive" controller="0" unit="1"/>
Oct 16 07:28:50 user nova-compute[74080]:     </disk>
Oct 16 07:28:50 user nova-compute[74080]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 16 07:28:50 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:28:50 user nova-compute[74080]:       <mac address="fa:16:3e:43:27:34"/>
Oct 16 07:28:50 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:50 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:28:50 user nova-compute[74080]:       <target dev="tapc9122dc8-47"/>
Oct 16 07:28:50 user nova-compute[74080]:     </interface>
Oct 16 07:28:50 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:28:50 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/console.log" append="off"/>
Oct 16 07:28:50 user nova-compute[74080]:     </serial>
Oct 16 07:28:50 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:28:50 user nova-compute[74080]:     <video>
Oct 16 07:28:50 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:50 user nova-compute[74080]:     </video>
Oct 16 07:28:50 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:28:50 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:28:50 user nova-compute[74080]:     </rng>
Oct 16 07:28:50 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:28:50 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:28:50 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:28:50 user nova-compute[74080]:     </memballoon>
Oct 16 07:28:50 user nova-compute[74080]:   </devices>
Oct 16 07:28:50 user nova-compute[74080]: </domain>
Oct 16 07:28:50 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1255670706',display_name='tempest-AttachSCSIVolumeTestJSON-server-1255670706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1255670706',id=6,image_ref='71d403eb-cb21-41d8-b469-8f26f2b1e23d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+T/FWygI73lXgVWqpGbqIOsSrVKd6DBPaSaS7IJKbc8ShYsjbebH6l31+26/VHSRbsEe0pD8//STUjYH8Fiq5PQxVHt/oG8SPbmKJSfsSghBJBAOtRUw/gJ9BrS1U8Kw==',key_name='tempest-keypair-1101819471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b62034e9a9464aa28d72ba8ae3333c54',ramdisk_id='',reservation_id='r-im4pyxoi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d403eb-cb21-41d8-b469-8f26f2b1e23d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1829758216',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1829758216-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b8cd76ab7a4d68b4f2826dc95e6eb1',uuid=5e0bc1db-0c8e-400b-814c-da5b19e74b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Converting VIF {"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:34,bridge_name='br-int',has_traffic_filtering=True,id=c9122dc8-4754-4fe0-84cc-9c119964eb16,network=Network(ef9c177b-20ca-4797-a4d5-83d83af3ecf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9122dc8-47') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG os_vif [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:34,bridge_name='br-int',has_traffic_filtering=True,id=c9122dc8-4754-4fe0-84cc-9c119964eb16,network=Network(ef9c177b-20ca-4797-a4d5-83d83af3ecf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9122dc8-47') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4c32bf9-1fc5-5db9-b7b8-41e62f97bfdd', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Releasing lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Instance network_info: |[{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] Acquired lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Refreshing network info cache for port 7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Start _get_guest_xml network_info=[{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9122dc8-47, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9122dc8-47, col_values=(('qos', UUID('6591b3e5-4556-4874-a5aa-dea916ef960e')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9122dc8-47, col_values=(('external_ids', {'iface-id': 'c9122dc8-4754-4fe0-84cc-9c119964eb16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:27:34', 'vm-uuid': '5e0bc1db-0c8e-400b-814c-da5b19e74b91'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: INFO os_vif [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:27:34,bridge_name='br-int',has_traffic_filtering=True,id=c9122dc8-4754-4fe0-84cc-9c119964eb16,network=Network(ef9c177b-20ca-4797-a4d5-83d83af3ecf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9122dc8-47')
Oct 16 07:28:50 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:50 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converting VIF {"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6f:2b,bridge_name='br-int',has_traffic_filtering=True,id=7d924de9-0e44-4edf-992f-d94e6d91a876,network=Network(3a953741-ae48-4e82-8ca9-aaac122ad027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d924de9-0e') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.objects.instance [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:28:50 user nova-compute[74080]:   <uuid>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</uuid>
Oct 16 07:28:50 user nova-compute[74080]:   <name>instance-00000005</name>
Oct 16 07:28:50 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:28:50 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:28:50 user nova-compute[74080]:   <metadata>
Oct 16 07:28:50 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:28:50 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:28:50</nova:creationTime>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:28:50 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:28:50 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:owner>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:28:50 user nova-compute[74080]:       </nova:owner>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:28:50 user nova-compute[74080]:       <nova:ports>
Oct 16 07:28:50 user nova-compute[74080]:         <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:28:50 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:28:50 user nova-compute[74080]:         </nova:port>
Oct 16 07:28:50 user nova-compute[74080]:       </nova:ports>
Oct 16 07:28:50 user nova-compute[74080]:     </nova:instance>
Oct 16 07:28:50 user nova-compute[74080]:   </metadata>
Oct 16 07:28:50 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:28:50 user nova-compute[74080]:     <system>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="serial">3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="uuid">3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:28:50 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:28:50 user nova-compute[74080]:     </system>
Oct 16 07:28:50 user nova-compute[74080]:   </sysinfo>
Oct 16 07:28:50 user nova-compute[74080]:   <os>
Oct 16 07:28:50 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:28:50 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:28:50 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:28:50 user nova-compute[74080]:   </os>
Oct 16 07:28:50 user nova-compute[74080]:   <features>
Oct 16 07:28:50 user nova-compute[74080]:     <acpi/>
Oct 16 07:28:50 user nova-compute[74080]:     <apic/>
Oct 16 07:28:50 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:28:50 user nova-compute[74080]:   </features>
Oct 16 07:28:50 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:28:50 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:28:50 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:28:50 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:28:50 user nova-compute[74080]:   </clock>
Oct 16 07:28:50 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:28:50 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:28:50 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:28:50 user nova-compute[74080]:   </cpu>
Oct 16 07:28:50 user nova-compute[74080]:   <devices>
Oct 16 07:28:50 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:28:50 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:28:50 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk"/>
Oct 16 07:28:50 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:28:50 user nova-compute[74080]:     </disk>
Oct 16 07:28:50 user nova-compute[74080]:     <disk type="file" device="cdrom">
Oct 16 07:28:50 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 07:28:50 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config"/>
Oct 16 07:28:50 user nova-compute[74080]:       <target dev="hda" bus="ide"/>
Oct 16 07:28:50 user nova-compute[74080]:     </disk>
Oct 16 07:28:50 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:28:50 user nova-compute[74080]:       <mac address="fa:16:3e:2f:6f:2b"/>
Oct 16 07:28:50 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:50 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:28:50 user nova-compute[74080]:       <target dev="tap7d924de9-0e"/>
Oct 16 07:28:50 user nova-compute[74080]:     </interface>
Oct 16 07:28:50 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:28:50 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log" append="off"/>
Oct 16 07:28:50 user nova-compute[74080]:     </serial>
Oct 16 07:28:50 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:28:50 user nova-compute[74080]:     <video>
Oct 16 07:28:50 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:28:50 user nova-compute[74080]:     </video>
Oct 16 07:28:50 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:28:50 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:28:50 user nova-compute[74080]:     </rng>
Oct 16 07:28:50 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:28:50 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:28:50 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:28:50 user nova-compute[74080]:     </memballoon>
Oct 16 07:28:50 user nova-compute[74080]:   </devices>
Oct 16 07:28:50 user nova-compute[74080]: </domain>
Oct 16 07:28:50 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converting VIF {"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6f:2b,bridge_name='br-int',has_traffic_filtering=True,id=7d924de9-0e44-4edf-992f-d94e6d91a876,network=Network(3a953741-ae48-4e82-8ca9-aaac122ad027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d924de9-0e') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG os_vif [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6f:2b,bridge_name='br-int',has_traffic_filtering=True,id=7d924de9-0e44-4edf-992f-d94e6d91a876,network=Network(3a953741-ae48-4e82-8ca9-aaac122ad027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d924de9-0e') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef269354-5e66-5ffb-9606-f9c53cbaa68e', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] No BDM found with device name sda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] No VIF found with MAC fa:16:3e:43:27:34, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:28:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Using config drive
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d924de9-0e, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d924de9-0e, col_values=(('qos', UUID('689f2ee7-1a16-47a2-b85f-2172a56ecaaa')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d924de9-0e, col_values=(('external_ids', {'iface-id': '7d924de9-0e44-4edf-992f-d94e6d91a876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:6f:2b', 'vm-uuid': '3dc7ff51-67ae-4d38-bf1f-e28483e40d5b'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:50 user nova-compute[74080]: INFO os_vif [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6f:2b,bridge_name='br-int',has_traffic_filtering=True,id=7d924de9-0e44-4edf-992f-d94e6d91a876,network=Network(3a953741-ae48-4e82-8ca9-aaac122ad027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d924de9-0e')
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No BDM found with device name hda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No VIF found with MAC fa:16:3e:2f:6f:2b, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:28:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Using config drive
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-a2d583f4-6b38-479a-8e3e-0905e94ef767 req-a420591c-6778-44d9-8de7-5ec8fe9bdbe9 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a2d583f4-6b38-479a-8e3e-0905e94ef767 req-a420591c-6778-44d9-8de7-5ec8fe9bdbe9 service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a2d583f4-6b38-479a-8e3e-0905e94ef767 req-a420591c-6778-44d9-8de7-5ec8fe9bdbe9 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a2d583f4-6b38-479a-8e3e-0905e94ef767 req-a420591c-6778-44d9-8de7-5ec8fe9bdbe9 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-a2d583f4-6b38-479a-8e3e-0905e94ef767 req-a420591c-6778-44d9-8de7-5ec8fe9bdbe9 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:50 user nova-compute[74080]: WARNING nova.compute.manager [req-a2d583f4-6b38-479a-8e3e-0905e94ef767 req-a420591c-6778-44d9-8de7-5ec8fe9bdbe9 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state active and task_state None.
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Updated VIF entry in instance network info cache for port c9122dc8-4754-4fe0-84cc-9c119964eb16. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Updating instance_info_cache with network_info: [{"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e35c64de-8678-478f-89fe-b3597432a5e2 req-f8485d86-d77e-4749-b305-8088744e64d0 service nova] Releasing lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Creating config drive at /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config
Oct 16 07:28:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp30e00i0o {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp30e00i0o" returned: 0 in 0.067s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:51 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Creating config drive at /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk.config
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphdmicb2z {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphdmicb2z" returned: 0 in 0.057s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updated VIF entry in instance network info cache for port 7d924de9-0e44-4edf-992f-d94e6d91a876. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d5408060-8737-439f-b2a9-4742b77d394b req-e698d605-a16b-4e6f-87e4-1bc1e5cf57a5 service nova] Releasing lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] No waiting events found dispatching network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:51 user nova-compute[74080]: WARNING nova.compute.manager [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received unexpected event network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 for instance with vm_state active and task_state None.
Oct 16 07:28:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] No waiting events found dispatching network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:51 user nova-compute[74080]: WARNING nova.compute.manager [req-971d471d-3e0c-4b26-ad69-38cb54c9090c req-fd4ea098-ce44-493e-a688-e6370642266a service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received unexpected event network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 for instance with vm_state active and task_state None.
Oct 16 07:28:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-c8d38f9a-3524-41be-9ff0-c3c64c3e9c4c req-5ceff7d4-1104-4ed1-816b-142617fdba30 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c8d38f9a-3524-41be-9ff0-c3c64c3e9c4c req-5ceff7d4-1104-4ed1-816b-142617fdba30 service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c8d38f9a-3524-41be-9ff0-c3c64c3e9c4c req-5ceff7d4-1104-4ed1-816b-142617fdba30 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c8d38f9a-3524-41be-9ff0-c3c64c3e9c4c req-5ceff7d4-1104-4ed1-816b-142617fdba30 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-c8d38f9a-3524-41be-9ff0-c3c64c3e9c4c req-5ceff7d4-1104-4ed1-816b-142617fdba30 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:52 user nova-compute[74080]: WARNING nova.compute.manager [req-c8d38f9a-3524-41be-9ff0-c3c64c3e9c4c req-5ceff7d4-1104-4ed1-816b-142617fdba30 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state active and task_state None.
Oct 16 07:28:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-eeccdddf-b787-4a24-8d45-149cd535918d req-2c5ebd6d-33eb-44e9-8771-0549a091eef1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eeccdddf-b787-4a24-8d45-149cd535918d req-2c5ebd6d-33eb-44e9-8771-0549a091eef1 service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eeccdddf-b787-4a24-8d45-149cd535918d req-2c5ebd6d-33eb-44e9-8771-0549a091eef1 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eeccdddf-b787-4a24-8d45-149cd535918d req-2c5ebd6d-33eb-44e9-8771-0549a091eef1 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-eeccdddf-b787-4a24-8d45-149cd535918d req-2c5ebd6d-33eb-44e9-8771-0549a091eef1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:53 user nova-compute[74080]: WARNING nova.compute.manager [req-eeccdddf-b787-4a24-8d45-149cd535918d req-2c5ebd6d-33eb-44e9-8771-0549a091eef1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received unexpected event network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 for instance with vm_state building and task_state spawning.
Oct 16 07:28:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-26f8e469-63a3-4bd2-ac9e-1af238b4a3c5 req-46a790d2-4a30-4627-a5b5-7cd08729ed18 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-26f8e469-63a3-4bd2-ac9e-1af238b4a3c5 req-46a790d2-4a30-4627-a5b5-7cd08729ed18 service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-26f8e469-63a3-4bd2-ac9e-1af238b4a3c5 req-46a790d2-4a30-4627-a5b5-7cd08729ed18 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-26f8e469-63a3-4bd2-ac9e-1af238b4a3c5 req-46a790d2-4a30-4627-a5b5-7cd08729ed18 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-26f8e469-63a3-4bd2-ac9e-1af238b4a3c5 req-46a790d2-4a30-4627-a5b5-7cd08729ed18 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:28:55 user nova-compute[74080]: WARNING nova.compute.manager [req-26f8e469-63a3-4bd2-ac9e-1af238b4a3c5 req-46a790d2-4a30-4627-a5b5-7cd08729ed18 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received unexpected event network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 for instance with vm_state building and task_state spawning.
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:28:56 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Instance spawned successfully.
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:28:56 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Instance spawned successfully.
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:28:57 user nova-compute[74080]: INFO nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Took 10.47 seconds to spawn the instance on the hypervisor.
Oct 16 07:28:57 user nova-compute[74080]: DEBUG nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:28:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:57 user nova-compute[74080]: INFO nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Took 9.85 seconds to spawn the instance on the hypervisor.
Oct 16 07:28:57 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:28:57 user nova-compute[74080]: INFO nova.compute.manager [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Took 12.11 seconds to build instance.
Oct 16 07:28:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-72a89200-60be-43a4-af95-2c85a06e11ad tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.270s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:57 user nova-compute[74080]: INFO nova.compute.manager [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Took 11.89 seconds to build instance.
Oct 16 07:28:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d1731fe9-4000-4465-ab0c-6d0c356ee614 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.097s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.009s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:28:58 user nova-compute[74080]: INFO nova.compute.claims [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Claim successful on node user
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.network.neutron [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:28:58 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:28:58 user nova-compute[74080]: DEBUG nova.policy [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a49123cad7b423186a3dcf52ffbf758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9da26bd07344cf784949d00a631aa1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:28:59 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Creating image(s)
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "/opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "/opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "/opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk 1073741824" returned: 0 in 0.065s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.276s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:28:59 user nova-compute[74080]: DEBUG nova.network.neutron [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Successfully created port: d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Cannot resize image /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Ensure instance console log exists: /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.network.neutron [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Successfully updated port: d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquired lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.network.neutron [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.compute.manager [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-changed-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.compute.manager [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Refreshing instance network info cache due to event network-changed-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] Acquiring lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:00 user nova-compute[74080]: DEBUG nova.network.neutron [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.network.neutron [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Updating instance_info_cache with network_info: [{"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Releasing lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Instance network_info: |[{"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] Acquired lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.network.neutron [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Refreshing network info cache for port d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Start _get_guest_xml network_info=[{"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:29:01 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:29:01 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-273747852',display_name='tempest-VolumesAssistedSnapshotsTest-server-273747852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-273747852',id=7,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3vtAFGT5mUtCrp4xBl0njKC2wgUrJGix8k3c5PHOV88ZEdx/nZQ7TJvfWqAHlYriaTMOdpJkycrBjadKGkwm+PeiIHTiroO85HOBpIxBLaW13wT61U3jxd7qILfw7Wpg==',key_name='tempest-keypair-191544254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9da26bd07344cf784949d00a631aa1d',ramdisk_id='',reservation_id='r-w88jebdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1847366625',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1847366625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a49123cad7b423186a3dcf52ffbf758',uuid=34cb3aed-3c32-460c-adb1-ab9c176be198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Converting VIF {"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:f7:c8,bridge_name='br-int',has_traffic_filtering=True,id=d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2,network=Network(fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98fac77-a3') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.objects.instance [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lazy-loading 'pci_devices' on Instance uuid 34cb3aed-3c32-460c-adb1-ab9c176be198 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:29:01 user nova-compute[74080]:   <uuid>34cb3aed-3c32-460c-adb1-ab9c176be198</uuid>
Oct 16 07:29:01 user nova-compute[74080]:   <name>instance-00000007</name>
Oct 16 07:29:01 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:29:01 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:29:01 user nova-compute[74080]:   <metadata>
Oct 16 07:29:01 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:29:01 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:29:01 user nova-compute[74080]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-273747852</nova:name>
Oct 16 07:29:01 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:29:01</nova:creationTime>
Oct 16 07:29:01 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:29:01 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:29:01 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:29:01 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:29:01 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:29:01 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:29:01 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:29:01 user nova-compute[74080]:       <nova:owner>
Oct 16 07:29:01 user nova-compute[74080]:         <nova:user uuid="6a49123cad7b423186a3dcf52ffbf758">tempest-VolumesAssistedSnapshotsTest-1847366625-project-member</nova:user>
Oct 16 07:29:01 user nova-compute[74080]:         <nova:project uuid="e9da26bd07344cf784949d00a631aa1d">tempest-VolumesAssistedSnapshotsTest-1847366625</nova:project>
Oct 16 07:29:01 user nova-compute[74080]:       </nova:owner>
Oct 16 07:29:01 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:29:01 user nova-compute[74080]:       <nova:ports>
Oct 16 07:29:01 user nova-compute[74080]:         <nova:port uuid="d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2">
Oct 16 07:29:01 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:29:01 user nova-compute[74080]:         </nova:port>
Oct 16 07:29:01 user nova-compute[74080]:       </nova:ports>
Oct 16 07:29:01 user nova-compute[74080]:     </nova:instance>
Oct 16 07:29:01 user nova-compute[74080]:   </metadata>
Oct 16 07:29:01 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:29:01 user nova-compute[74080]:     <system>
Oct 16 07:29:01 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:29:01 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:29:01 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:29:01 user nova-compute[74080]:       <entry name="serial">34cb3aed-3c32-460c-adb1-ab9c176be198</entry>
Oct 16 07:29:01 user nova-compute[74080]:       <entry name="uuid">34cb3aed-3c32-460c-adb1-ab9c176be198</entry>
Oct 16 07:29:01 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:29:01 user nova-compute[74080]:     </system>
Oct 16 07:29:01 user nova-compute[74080]:   </sysinfo>
Oct 16 07:29:01 user nova-compute[74080]:   <os>
Oct 16 07:29:01 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:29:01 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:29:01 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:29:01 user nova-compute[74080]:   </os>
Oct 16 07:29:01 user nova-compute[74080]:   <features>
Oct 16 07:29:01 user nova-compute[74080]:     <acpi/>
Oct 16 07:29:01 user nova-compute[74080]:     <apic/>
Oct 16 07:29:01 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:29:01 user nova-compute[74080]:   </features>
Oct 16 07:29:01 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:29:01 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:29:01 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:29:01 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:29:01 user nova-compute[74080]:   </clock>
Oct 16 07:29:01 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:29:01 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:29:01 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:29:01 user nova-compute[74080]:   </cpu>
Oct 16 07:29:01 user nova-compute[74080]:   <devices>
Oct 16 07:29:01 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:29:01 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:29:01 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk"/>
Oct 16 07:29:01 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:29:01 user nova-compute[74080]:     </disk>
Oct 16 07:29:01 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:29:01 user nova-compute[74080]:       <mac address="fa:16:3e:61:f7:c8"/>
Oct 16 07:29:01 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:29:01 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:29:01 user nova-compute[74080]:       <target dev="tapd98fac77-a3"/>
Oct 16 07:29:01 user nova-compute[74080]:     </interface>
Oct 16 07:29:01 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:29:01 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/console.log" append="off"/>
Oct 16 07:29:01 user nova-compute[74080]:     </serial>
Oct 16 07:29:01 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:29:01 user nova-compute[74080]:     <video>
Oct 16 07:29:01 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:29:01 user nova-compute[74080]:     </video>
Oct 16 07:29:01 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:29:01 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:29:01 user nova-compute[74080]:     </rng>
Oct 16 07:29:01 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:29:01 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:29:01 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:29:01 user nova-compute[74080]:     </memballoon>
Oct 16 07:29:01 user nova-compute[74080]:   </devices>
Oct 16 07:29:01 user nova-compute[74080]: </domain>
Oct 16 07:29:01 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-273747852',display_name='tempest-VolumesAssistedSnapshotsTest-server-273747852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-273747852',id=7,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3vtAFGT5mUtCrp4xBl0njKC2wgUrJGix8k3c5PHOV88ZEdx/nZQ7TJvfWqAHlYriaTMOdpJkycrBjadKGkwm+PeiIHTiroO85HOBpIxBLaW13wT61U3jxd7qILfw7Wpg==',key_name='tempest-keypair-191544254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9da26bd07344cf784949d00a631aa1d',ramdisk_id='',reservation_id='r-w88jebdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1847366625',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1847366625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a49123cad7b423186a3dcf52ffbf758',uuid=34cb3aed-3c32-460c-adb1-ab9c176be198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Converting VIF {"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:f7:c8,bridge_name='br-int',has_traffic_filtering=True,id=d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2,network=Network(fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98fac77-a3') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG os_vif [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:f7:c8,bridge_name='br-int',has_traffic_filtering=True,id=d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2,network=Network(fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98fac77-a3') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8d95c31-2db9-510a-9405-70c0c7526e52', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd98fac77-a3, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd98fac77-a3, col_values=(('qos', UUID('408ed83d-e5d0-4ccf-b677-79db0d7b4f33')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd98fac77-a3, col_values=(('external_ids', {'iface-id': 'd98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:f7:c8', 'vm-uuid': '34cb3aed-3c32-460c-adb1-ab9c176be198'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:01 user nova-compute[74080]: INFO os_vif [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:f7:c8,bridge_name='br-int',has_traffic_filtering=True,id=d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2,network=Network(fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98fac77-a3')
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:29:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] No VIF found with MAC fa:16:3e:61:f7:c8, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:29:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Updated VIF entry in instance network info cache for port d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:29:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Updating instance_info_cache with network_info: [{"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cb938fcb-4996-4397-b0a5-a5445790e035 req-3b4782be-d076-405b-9b15-199191974d9d service nova] Releasing lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-4fce0e6e-c83c-45e2-8f32-34cca6bc4716 req-960903cb-5118-4bba-8423-af737086d046 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4fce0e6e-c83c-45e2-8f32-34cca6bc4716 req-960903cb-5118-4bba-8423-af737086d046 service nova] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4fce0e6e-c83c-45e2-8f32-34cca6bc4716 req-960903cb-5118-4bba-8423-af737086d046 service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4fce0e6e-c83c-45e2-8f32-34cca6bc4716 req-960903cb-5118-4bba-8423-af737086d046 service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-4fce0e6e-c83c-45e2-8f32-34cca6bc4716 req-960903cb-5118-4bba-8423-af737086d046 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] No waiting events found dispatching network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:29:04 user nova-compute[74080]: WARNING nova.compute.manager [req-4fce0e6e-c83c-45e2-8f32-34cca6bc4716 req-960903cb-5118-4bba-8423-af737086d046 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received unexpected event network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 for instance with vm_state building and task_state spawning.
Oct 16 07:29:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c827932-1255-46df-a4cb-1e2aacdccba4 req-96422099-2d4e-46b2-8885-0d205b06706f service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c827932-1255-46df-a4cb-1e2aacdccba4 req-96422099-2d4e-46b2-8885-0d205b06706f service nova] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c827932-1255-46df-a4cb-1e2aacdccba4 req-96422099-2d4e-46b2-8885-0d205b06706f service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c827932-1255-46df-a4cb-1e2aacdccba4 req-96422099-2d4e-46b2-8885-0d205b06706f service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c827932-1255-46df-a4cb-1e2aacdccba4 req-96422099-2d4e-46b2-8885-0d205b06706f service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] No waiting events found dispatching network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:29:06 user nova-compute[74080]: WARNING nova.compute.manager [req-3c827932-1255-46df-a4cb-1e2aacdccba4 req-96422099-2d4e-46b2-8885-0d205b06706f service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received unexpected event network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 for instance with vm_state building and task_state spawning.
Oct 16 07:29:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:29:06 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Instance spawned successfully.
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:29:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:29:07 user nova-compute[74080]: INFO nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Took 7.98 seconds to spawn the instance on the hypervisor.
Oct 16 07:29:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:07 user nova-compute[74080]: INFO nova.compute.manager [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Took 8.98 seconds to build instance.
Oct 16 07:29:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd030ba6-21c0-4229-94b1-09a11126c92a tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.163s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] There are 0 instances to clean {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-cd311b39-9b77-4e6a-9b30-c4d237fd5c02 req-2394b966-8225-422c-9de5-d30551270dae service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cd311b39-9b77-4e6a-9b30-c4d237fd5c02 req-2394b966-8225-422c-9de5-d30551270dae service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cd311b39-9b77-4e6a-9b30-c4d237fd5c02 req-2394b966-8225-422c-9de5-d30551270dae service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cd311b39-9b77-4e6a-9b30-c4d237fd5c02 req-2394b966-8225-422c-9de5-d30551270dae service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-cd311b39-9b77-4e6a-9b30-c4d237fd5c02 req-2394b966-8225-422c-9de5-d30551270dae service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:29:07 user nova-compute[74080]: WARNING nova.compute.manager [req-cd311b39-9b77-4e6a-9b30-c4d237fd5c02 req-2394b966-8225-422c-9de5-d30551270dae service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received unexpected event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with vm_state active and task_state None.
Oct 16 07:29:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:08 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:29:09 user nova-compute[74080]: WARNING nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received unexpected event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with vm_state active and task_state None.
Oct 16 07:29:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] No waiting events found dispatching network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:29:09 user nova-compute[74080]: WARNING nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received unexpected event network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 for instance with vm_state active and task_state None.
Oct 16 07:29:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] No waiting events found dispatching network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:29:09 user nova-compute[74080]: WARNING nova.compute.manager [req-6dd622da-8296-459d-84e0-aa965c5a9f3e req-965672d5-2b23-40ff-b932-0584cfdf6db5 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received unexpected event network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 for instance with vm_state active and task_state None.
Oct 16 07:29:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lazy-loading 'info_cache' on Instance uuid 9ca2ec50-7468-41d7-9bab-5021f4875604 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updating instance_info_cache with network_info: [{"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-9ca2ec50-7468-41d7-9bab-5021f4875604" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.356s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:29:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7781MB free_disk=25.66736602783203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 9ca2ec50-7468-41d7-9bab-5021f4875604 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f055134f-7d13-4ee6-9dfa-11207791a674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 34cb3aed-3c32-460c-adb1-ab9c176be198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:29:14 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:29:15 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:29:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:29:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:15 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:15 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:15 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:29:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "1c601514-628d-4f45-9d06-e8eebc943253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:29:41 user nova-compute[74080]: INFO nova.compute.claims [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Claim successful on node user
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Refreshing inventories for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Updating ProviderTree inventory for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Updating inventory in ProviderTree for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Refreshing aggregate associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, aggregates: None {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Refreshing trait associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:29:41 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:29:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:29:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:29:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:29:42 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:29:42 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:29:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:29:42 user nova-compute[74080]: INFO nova.virt.block_device [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Booting with volume 38ce8414-2334-4f99-9396-32111d1658eb at /dev/vda
Oct 16 07:29:42 user nova-compute[74080]: DEBUG nova.policy [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1be7ad61fd24c4684ee8243a698254f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76728d3f4b6f4ddba8a74ac0c4b7179a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:29:42 user nova-compute[74080]: DEBUG os_brick.utils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:29:42 user nova-compute[74080]: INFO oslo.privsep.daemon [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp5mg6f739/privsep.sock']
Oct 16 07:29:42 user sudo[85086]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp5mg6f739/privsep.sock
Oct 16 07:29:42 user sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 07:29:42 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully created port: be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:29:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully created port: 194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:29:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully created port: ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:29:43 user sudo[85086]: pam_unix(sudo:session): session closed for user root
Oct 16 07:29:43 user nova-compute[74080]: INFO oslo.privsep.daemon [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Spawned new privsep daemon via rootwrap
Oct 16 07:29:43 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 07:29:43 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 07:29:43 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 16 07:29:43 user nova-compute[74080]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85089
Oct 16 07:29:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[036f980c-df46-49c1-967d-97e86ee9b51a]: (2,) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69909a-8fac-4f55-8781-3ff6cb369795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:44 user nova-compute[74080]: WARNING os_brick.initiator.connectors.nvmeof [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[616050fc-f55c-4f08-9756-e1af046c221a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4be5b2-fd84-4aa2-8d5f-02f72eabd109]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d69bf-9f32-49e9-ab58-410c09e52180]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:29:44 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:29:44 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb46818-ff46-4f24-a118-d4d5edd9d3bd]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully created port: eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG os_brick.utils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== get_connector_properties: return (1943ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating existing volume attachment record: 902ce8c4-29a5-46ea-83ba-31e5baee6692 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:29:44 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully created port: f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:29:45 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully updated port: be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-be7d6378-4572-41b5-84b0-8fb7a4ea2462. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:45 user nova-compute[74080]: DEBUG nova.network.neutron [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:45 user nova-compute[74080]: DEBUG nova.network.neutron [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e71e34e-40de-4ba1-8f42-12e423493c34 req-4e5c17cf-b25a-4314-9fd8-632e03c20865 service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully updated port: 4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:29:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:47 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully updated port: ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-4320ab8c-b62d-43d5-9bb5-437734f4a2d4. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:47 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port 4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:47 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-ee963755-1263-499a-a771-1c77e22cfc29. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2d0710a-9be0-4453-a0d2-75b8f74d9eb5 req-0df50fdb-68c1-44b0-95e6-bda53bc3231c service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully updated port: 194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully updated port: ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-194793c2-2ef3-4aca-967e-4ad828705eaa. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port 194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully updated port: eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-ab3d113c-866b-49e3-8948-c70a8f3e9a27. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d217c869-4aa9-4f25-a73f-5415ca08b094 req-6a2c1ba7-a8b0-430c-a5d4-0f96ff329100 service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Successfully updated port: f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:29:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:29:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-eda54889-1294-4127-80f4-f2b9e5ac300c. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [{"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance network_info: |[{"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.network.neutron [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.network.neutron [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updated VIF entry in instance network info cache for port eda54889-1294-4127-80f4-f2b9e5ac300c. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.network.neutron [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [{"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-f54431da-f912-4c71-ba33-58340ed9b731. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:29:52 user nova-compute[74080]: DEBUG nova.network.neutron [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:29:53 user nova-compute[74080]: DEBUG nova.network.neutron [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updated VIF entry in instance network info cache for port f54431da-f912-4c71-ba33-58340ed9b731. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:29:53 user nova-compute[74080]: DEBUG nova.network.neutron [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [{"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:29:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2bbf30c6-b0f6-4db9-b33e-638f92703ae4 req-c318b623-cd85-40eb-b57b-713ba2f72fd2 service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:29:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:29:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 07:29:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:29:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:29:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:29:58 user nova-compute[74080]: INFO nova.virt.block_device [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Booting with volume 152716bd-0c7e-48b2-a6bd-9b15cda007b6 at /dev/vdb
Oct 16 07:29:58 user nova-compute[74080]: DEBUG os_brick.utils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.011s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbaa930-7dc6-4656-94ed-db46602d5f30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ba2309-dfd1-4f29-9737-f99d77b3635d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc4125-5c2e-4ffc-96de-a7018d244532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e3971f-bc12-461a-90a7-0b865c22ecbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:29:58 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:29:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f0fd0-bcfc-4c88-8938-f7db0789fc04]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG os_brick.utils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:29:58 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating existing volume attachment record: e2ecdd49-c73f-4177-bbec-eebf0ff84fa3 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG nova.objects.instance [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lazy-loading 'flavor' on Instance uuid 9ca2ec50-7468-41d7-9bab-5021f4875604 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:10 user nova-compute[74080]: INFO nova.compute.manager [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Attaching volume 05969d64-02be-4924-bf37-7d6cb9366cd7 to /dev/vdb
Oct 16 07:30:10 user nova-compute[74080]: DEBUG os_brick.utils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bff70e0-0a74-47b0-98c4-f1df08f0b5ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb1b384-3f6f-4eab-b1b4-993a4e3140c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f82d0f-78b7-493a-9388-39526b5da4a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9046c641-c250-402a-96fa-e045e8a6cc73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:10 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[56746657-a9d1-4e29-b0f3-28d7c4ada10c]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG os_brick.utils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:10 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updating existing volume attachment record: 72cdbffb-c1cc-4fe8-86f3-3983e52a5769 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:11 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:30:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:11 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:30:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-changed-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Refreshing instance network info cache due to event network-changed-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.network.neutron [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Refreshing network info cache for port 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.network.neutron [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updated VIF entry in instance network info cache for port 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG nova.network.neutron [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f23dee5d-1f77-4477-8589-139a5c0a47d9 req-beac28be-491b-488a-af9f-5b2ecbbd08be service nova] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: INFO nova.virt.block_device [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Booting with volume f5db36cc-2767-4528-bcc2-8418805c9a46 at /dev/vdc
Oct 16 07:30:13 user nova-compute[74080]: DEBUG os_brick.utils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b68ab0-a5a7-4a21-b0af-43dce7580ca7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a400d5d-4a89-4f23-8a43-f472bcd87792]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbc402-61ad-46e5-91d9-a8523d7692f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0eeae86-8b8c-4cfa-9c31-e06c4dd05f95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:13 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe762cb-c767-4047-ac32-c205ac2283cf]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG os_brick.utils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating existing volume attachment record: bff29fc3-8366-4de1-8edc-b05cc35e752a {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-changed-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Refreshing instance network info cache due to event network-changed-8165e494-572c-4bae-9f3b-da85a6f9c676. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] Acquiring lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] Acquired lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Refreshing network info cache for port 8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updated VIF entry in instance network info cache for port 8165e494-572c-4bae-9f3b-da85a6f9c676. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updating instance_info_cache with network_info: [{"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-83f91e3a-4755-45c3-9e26-d672c286cda3 req-80cf0fd7-46b4-403a-8c66-52bc42554a14 service nova] Releasing lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:15 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:30:15 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7651MB free_disk=25.578414916992188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 9ca2ec50-7468-41d7-9bab-5021f4875604 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f055134f-7d13-4ee6-9dfa-11207791a674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 34cb3aed-3c32-460c-adb1-ab9c176be198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1c601514-628d-4f45-9d06-e8eebc943253 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:30:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:30:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:18 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG nova.objects.instance [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:19 user nova-compute[74080]: INFO nova.compute.manager [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Attaching volume 3e7ac34b-c1b3-444b-8216-b2ef2babecba to /dev/vdb
Oct 16 07:30:19 user nova-compute[74080]: DEBUG os_brick.utils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b78096-cfc1-4ad8-971e-9d80a62b30b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7acb703-0197-41d0-8100-423b15ac2a23]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3a85c9-fcb9-4b20-81e0-be115bad826d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e8384-b072-4407-ada1-1b2ec82283b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:19 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9381a-5a76-40d5-93c1-942ed1b57f4c]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG os_brick.utils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:19 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updating existing volume attachment record: c26d67e0-a8d5-4b75-87f4-3287357154da {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:28 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:30:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:30:28 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Creating image(s)
Oct 16 07:30:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:30:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Ensure instance console log exists: /opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:30:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Start _get_guest_xml network_info=[{"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '902ce8c4-29a5-46ea-83ba-31e5baee6692', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKIfacNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c601514-628d-4f45-9d06-e8eebc943253', 'attached_at': '', 'detached_at': '', 'volume_id': '38ce8414-2334-4f99-9396-32111d1658eb', 'serial': '38ce8414-2334-4f99-9396-32111d1658eb'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': 'e2ecdd49-c73f-4177-bbec-eebf0ff84fa3', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNDXqFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c601514-628d-4f45-9d06-e8eebc943253', 'attached_at': '', 'detached_at': '', 'volume_id': '152716bd-0c7e-48b2-a6bd-9b15cda007b6', 'serial': '152716bd-0c7e-48b2-a6bd-9b15cda007b6'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'bff29fc3-8366-4de1-8edc-b05cc35e752a', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgWxECqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c601514-628d-4f45-9d06-e8eebc943253', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5db36cc-2767-4528-bcc2-8418805c9a46', 'serial': 'f5db36cc-2767-4528-bcc2-8418805c9a46'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:30:28 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:30:29 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connector [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Factory for ISCSI on None {{(pid=74080) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKIfacNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:29 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:29 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:29 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3f6dc-7ec3-465f-aaca-899da95de34f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:30:29 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b385e99-afec-4fcd-8f58-3b0466de3a39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb] added
Oct 16 07:30:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f971ed75-1942-486f-998e-9c87ee238b4d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[47aecab0-b71d-4a25-a610-8b58b0547a26]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKIfacNp {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zKIfacNp" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b5733-7c07-4fa0-9314-30d0eccda648]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zKIfacNp'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c8516-1d38-43a2-931d-5d866d192653]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f9ef49-738d-48f5-a568-ae2f49309dd8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 07:30:29 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 07:30:29 user nova-compute[74080]:  {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:29 user nova-compute[74080]: WARNING os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 07:30:29 user nova-compute[74080]: 
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12f9e4a-41e9-4a12-9a69-7fc09f1d8b15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260]
Oct 16 07:30:29 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260] successful.
Oct 16 07:30:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f209ac55-8bf8-44ed-9580-da90035454dc]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe16b55e-d9c1-431a-8dac-2bf20f8fd9a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab395a-a857-4016-a9dd-1a3c007265e7]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKIfacNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-changed-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Refreshing instance network info cache due to event network-changed-f4208389-c89e-435b-8e7f-e34473a939b6. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] Acquiring lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] Acquired lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Refreshing network info cache for port f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23338306464323035', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338306464323035', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updated VIF entry in instance network info cache for port f4208389-c89e-435b-8e7f-e34473a939b6. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating instance_info_cache with network_info: [{"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNDXqFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:30 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:30 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:30 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-432da212-5961-4454-8eaa-e257c81ed693 req-45a6b5cf-7daf-4f27-8135-3d7807f35675 service nova] Releasing lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1490913a-5861-435c-b82a-821089eb43dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:30:30 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a088638-05d8-4d93-bfd3-abf8aae1becd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6] added
Oct 16 07:30:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f69d512-a912-431e-928b-9c4ed710339e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9b843c-c0b6-49e0-8263-02dbb3e3bee3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leNDXqFv {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leNDXqFv" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c671ced-763a-4a7b-8995-f6f7b9afbe4b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'leNDXqFv'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5615ee4-edb4-4b91-b067-c817b68203f1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d599ea-93e5-40a2-a957-e0b15978fcbb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0f6ff9-3b31-4fe9-9707-9054987e385e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260]
Oct 16 07:30:30 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260] successful.
Oct 16 07:30:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8066a48c-b629-4d25-a991-b5967cd4bf08]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6370f2-8e46-4ff8-9b05-ade35949d6e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:30 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:30 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ab2755-a45b-49cf-bdbd-b0878b885606]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNDXqFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "04e528d5-491a-4914-a1b2-7eee4efc0caf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:30 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:30:31 user nova-compute[74080]: INFO nova.compute.claims [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Claim successful on node user
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:30:31 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.policy [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33b58ae309d047548ebf29684db6037e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b70039a31c47f39f7bf1b01b4e6e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26332323433666130', 'path': '/dev/sdc'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332323433666130', 'path': '/dev/sdc'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:30:31 user nova-compute[74080]: INFO nova.virt.block_device [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Booting with volume snapshot aa30547a-38ce-474e-bc00-cd3b968652c6 at /dev/vda
Oct 16 07:30:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgWxECqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:31 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:31 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:31 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa186657-aa31-49e7-ad33-f48c93c20ff5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:30:31 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e3aa40-b15e-42c4-8d00-3eab6c9b6fbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46] added
Oct 16 07:30:31 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23e9082-8448-4d0f-b282-4e6262562e0c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da4e2a6-49f2-455c-8dae-02e5523d1c9a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgWxECqP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgWxECqP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d198be-6ef3-4869-b90d-e1fe367f3b51]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgWxECqP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81b431-0d0a-4f6c-bc6c-eac03c19c2ec]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc04bc7c-525e-473c-83a1-4bef9cfc1d5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:31 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:31 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:31 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:31 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b43f0-f8e1-4bdc-8ecd-da96b41f9111]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260]
Oct 16 07:30:32 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260] successful.
Oct 16 07:30:32 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d79f0-693b-42e9-8879-16cfe9078a35]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25d9a5-d16f-462a-98d7-48fe358015c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:32 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:32 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:32 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:32 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:32 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:32 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b29479-1d06-4a1d-aa2d-bad48e9d613f]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgWxECqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:32 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Successfully created port: b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26533613866633737', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533613866633737', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=be7d6378-4572-41b5-84b0-8fb7a4ea2462,network=Network(f2da2576-47cf-481a-a687-922a46299e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7d6378-45') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:68:91,bridge_name='br-int',has_traffic_filtering=True,id=4320ab8c-b62d-43d5-9bb5-437734f4a2d4,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4320ab8c-b6') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:b5,bridge_name='br-int',has_traffic_filtering=True,id=ee963755-1263-499a-a771-1c77e22cfc29,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee963755-12') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:52,bridge_name='br-int',has_traffic_filtering=True,id=194793c2-2ef3-4aca-967e-4ad828705eaa,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194793c2-2e') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=ab3d113c-866b-49e3-8948-c70a8f3e9a27,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3d113c-86') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:0b:55,bridge_name='br-int',has_traffic_filtering=True,id=eda54889-1294-4127-80f4-f2b9e5ac300c,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda54889-12') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:62:15,bridge_name='br-int',has_traffic_filtering=True,id=f54431da-f912-4c71-ba33-58340ed9b731,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54431da-f9') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.objects.instance [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c601514-628d-4f45-9d06-e8eebc943253 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:30:33 user nova-compute[74080]:   <uuid>1c601514-628d-4f45-9d06-e8eebc943253</uuid>
Oct 16 07:30:33 user nova-compute[74080]:   <name>instance-00000008</name>
Oct 16 07:30:33 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:30:33 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:30:33 user nova-compute[74080]:   <metadata>
Oct 16 07:30:33 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:30:33 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:30:33 user nova-compute[74080]:       <nova:name>tempest-device-tagging-server-2095147051</nova:name>
Oct 16 07:30:33 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:30:29</nova:creationTime>
Oct 16 07:30:33 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:30:33 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:30:33 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:30:33 user nova-compute[74080]:       <nova:owner>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:user uuid="e1be7ad61fd24c4684ee8243a698254f">tempest-TaggedBootDevicesTest_v242-1639502304-project-member</nova:user>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:project uuid="76728d3f4b6f4ddba8a74ac0c4b7179a">tempest-TaggedBootDevicesTest_v242-1639502304</nova:project>
Oct 16 07:30:33 user nova-compute[74080]:       </nova:owner>
Oct 16 07:30:33 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:30:33 user nova-compute[74080]:       <nova:ports>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:port uuid="be7d6378-4572-41b5-84b0-8fb7a4ea2462">
Oct 16 07:30:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 07:30:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:port uuid="4320ab8c-b62d-43d5-9bb5-437734f4a2d4">
Oct 16 07:30:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
Oct 16 07:30:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:port uuid="ee963755-1263-499a-a771-1c77e22cfc29">
Oct 16 07:30:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.25" ipVersion="4"/>
Oct 16 07:30:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:port uuid="194793c2-2ef3-4aca-967e-4ad828705eaa">
Oct 16 07:30:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Oct 16 07:30:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:port uuid="ab3d113c-866b-49e3-8948-c70a8f3e9a27">
Oct 16 07:30:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Oct 16 07:30:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:port uuid="eda54889-1294-4127-80f4-f2b9e5ac300c">
Oct 16 07:30:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 16 07:30:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:33 user nova-compute[74080]:         <nova:port uuid="f54431da-f912-4c71-ba33-58340ed9b731">
Oct 16 07:30:33 user nova-compute[74080]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 16 07:30:33 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:33 user nova-compute[74080]:       </nova:ports>
Oct 16 07:30:33 user nova-compute[74080]:     </nova:instance>
Oct 16 07:30:33 user nova-compute[74080]:   </metadata>
Oct 16 07:30:33 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:30:33 user nova-compute[74080]:     <system>
Oct 16 07:30:33 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:30:33 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:30:33 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:30:33 user nova-compute[74080]:       <entry name="serial">1c601514-628d-4f45-9d06-e8eebc943253</entry>
Oct 16 07:30:33 user nova-compute[74080]:       <entry name="uuid">1c601514-628d-4f45-9d06-e8eebc943253</entry>
Oct 16 07:30:33 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:30:33 user nova-compute[74080]:     </system>
Oct 16 07:30:33 user nova-compute[74080]:   </sysinfo>
Oct 16 07:30:33 user nova-compute[74080]:   <os>
Oct 16 07:30:33 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:30:33 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:30:33 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:30:33 user nova-compute[74080]:   </os>
Oct 16 07:30:33 user nova-compute[74080]:   <features>
Oct 16 07:30:33 user nova-compute[74080]:     <acpi/>
Oct 16 07:30:33 user nova-compute[74080]:     <apic/>
Oct 16 07:30:33 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:30:33 user nova-compute[74080]:   </features>
Oct 16 07:30:33 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:30:33 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:30:33 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:30:33 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:30:33 user nova-compute[74080]:   </clock>
Oct 16 07:30:33 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:30:33 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:30:33 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:30:33 user nova-compute[74080]:   </cpu>
Oct 16 07:30:33 user nova-compute[74080]:   <devices>
Oct 16 07:30:33 user nova-compute[74080]:     <disk type="file" device="cdrom">
Oct 16 07:30:33 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 07:30:33 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253/disk.config"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="hda" bus="ide"/>
Oct 16 07:30:33 user nova-compute[74080]:     </disk>
Oct 16 07:30:33 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:30:33 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:30:33 user nova-compute[74080]:       <source dev="/dev/sdb"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <serial>38ce8414-2334-4f99-9396-32111d1658eb</serial>
Oct 16 07:30:33 user nova-compute[74080]:     </disk>
Oct 16 07:30:33 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:30:33 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:30:33 user nova-compute[74080]:       <source dev="/dev/sdc"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <serial>152716bd-0c7e-48b2-a6bd-9b15cda007b6</serial>
Oct 16 07:30:33 user nova-compute[74080]:     </disk>
Oct 16 07:30:33 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:30:33 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:30:33 user nova-compute[74080]:       <source dev="/dev/sdd"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="vdc" bus="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <serial>f5db36cc-2767-4528-bcc2-8418805c9a46</serial>
Oct 16 07:30:33 user nova-compute[74080]:     </disk>
Oct 16 07:30:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:33 user nova-compute[74080]:       <mac address="fa:16:3e:09:4f:ea"/>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="tapbe7d6378-45"/>
Oct 16 07:30:33 user nova-compute[74080]:     </interface>
Oct 16 07:30:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:33 user nova-compute[74080]:       <mac address="fa:16:3e:ce:68:91"/>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="tap4320ab8c-b6"/>
Oct 16 07:30:33 user nova-compute[74080]:     </interface>
Oct 16 07:30:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:33 user nova-compute[74080]:       <mac address="fa:16:3e:a8:17:b5"/>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="tapee963755-12"/>
Oct 16 07:30:33 user nova-compute[74080]:     </interface>
Oct 16 07:30:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:33 user nova-compute[74080]:       <mac address="fa:16:3e:ce:22:52"/>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="tap194793c2-2e"/>
Oct 16 07:30:33 user nova-compute[74080]:     </interface>
Oct 16 07:30:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:33 user nova-compute[74080]:       <mac address="fa:16:3e:26:b9:98"/>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="tapab3d113c-86"/>
Oct 16 07:30:33 user nova-compute[74080]:     </interface>
Oct 16 07:30:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:33 user nova-compute[74080]:       <mac address="fa:16:3e:8a:0b:55"/>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="tapeda54889-12"/>
Oct 16 07:30:33 user nova-compute[74080]:     </interface>
Oct 16 07:30:33 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:33 user nova-compute[74080]:       <mac address="fa:16:3e:c9:62:15"/>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:33 user nova-compute[74080]:       <target dev="tapf54431da-f9"/>
Oct 16 07:30:33 user nova-compute[74080]:     </interface>
Oct 16 07:30:33 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:30:33 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253/console.log" append="off"/>
Oct 16 07:30:33 user nova-compute[74080]:     </serial>
Oct 16 07:30:33 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:30:33 user nova-compute[74080]:     <video>
Oct 16 07:30:33 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:33 user nova-compute[74080]:     </video>
Oct 16 07:30:33 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:30:33 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:30:33 user nova-compute[74080]:     </rng>
Oct 16 07:30:33 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:30:33 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:30:33 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:30:33 user nova-compute[74080]:     </memballoon>
Oct 16 07:30:33 user nova-compute[74080]:   </devices>
Oct 16 07:30:33 user nova-compute[74080]: </domain>
Oct 16 07:30:33 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=be7d6378-4572-41b5-84b0-8fb7a4ea2462,network=Network(f2da2576-47cf-481a-a687-922a46299e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7d6378-45') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=be7d6378-4572-41b5-84b0-8fb7a4ea2462,network=Network(f2da2576-47cf-481a-a687-922a46299e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7d6378-45') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '794ad904-6394-591d-b187-e51824c36818', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe7d6378-45, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe7d6378-45, col_values=(('qos', UUID('83ec1e31-ecc7-4a10-b8e3-45d3e4d0f507')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe7d6378-45, col_values=(('external_ids', {'iface-id': 'be7d6378-4572-41b5-84b0-8fb7a4ea2462', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:4f:ea', 'vm-uuid': '1c601514-628d-4f45-9d06-e8eebc943253'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: INFO os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=be7d6378-4572-41b5-84b0-8fb7a4ea2462,network=Network(f2da2576-47cf-481a-a687-922a46299e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7d6378-45')
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:68:91,bridge_name='br-int',has_traffic_filtering=True,id=4320ab8c-b62d-43d5-9bb5-437734f4a2d4,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4320ab8c-b6') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:68:91,bridge_name='br-int',has_traffic_filtering=True,id=4320ab8c-b62d-43d5-9bb5-437734f4a2d4,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4320ab8c-b6') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0badf128-6ab6-54ac-9675-4c8253cdfd75', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4320ab8c-b6, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4320ab8c-b6, col_values=(('qos', UUID('878416e0-57a3-44ef-b27c-ec475130ed6b')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4320ab8c-b6, col_values=(('external_ids', {'iface-id': '4320ab8c-b62d-43d5-9bb5-437734f4a2d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:68:91', 'vm-uuid': '1c601514-628d-4f45-9d06-e8eebc943253'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: INFO os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:68:91,bridge_name='br-int',has_traffic_filtering=True,id=4320ab8c-b62d-43d5-9bb5-437734f4a2d4,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4320ab8c-b6')
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:b5,bridge_name='br-int',has_traffic_filtering=True,id=ee963755-1263-499a-a771-1c77e22cfc29,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee963755-12') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:b5,bridge_name='br-int',has_traffic_filtering=True,id=ee963755-1263-499a-a771-1c77e22cfc29,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee963755-12') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43071093-f039-5b54-adad-c572efb90d1c', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Successfully updated port: b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee963755-12, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee963755-12, col_values=(('qos', UUID('baf8aec5-abd9-4adc-9050-31e19eca1cdd')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee963755-12, col_values=(('external_ids', {'iface-id': 'ee963755-1263-499a-a771-1c77e22cfc29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:17:b5', 'vm-uuid': '1c601514-628d-4f45-9d06-e8eebc943253'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "refresh_cache-04e528d5-491a-4914-a1b2-7eee4efc0caf" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquired lock "refresh_cache-04e528d5-491a-4914-a1b2-7eee4efc0caf" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: INFO os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:b5,bridge_name='br-int',has_traffic_filtering=True,id=ee963755-1263-499a-a771-1c77e22cfc29,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee963755-12')
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:52,bridge_name='br-int',has_traffic_filtering=True,id=194793c2-2ef3-4aca-967e-4ad828705eaa,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194793c2-2e') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:52,bridge_name='br-int',has_traffic_filtering=True,id=194793c2-2ef3-4aca-967e-4ad828705eaa,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194793c2-2e') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received event network-changed-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Refreshing instance network info cache due to event network-changed-b381aba5-0dfe-4d9d-85d3-32f84e65bc78. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] Acquiring lock "refresh_cache-04e528d5-491a-4914-a1b2-7eee4efc0caf" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd10068b-64d9-54d2-ad04-eece1cb8ab0f', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap194793c2-2e, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap194793c2-2e, col_values=(('qos', UUID('2910da20-2ce6-44cb-b166-68be7d2786a1')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap194793c2-2e, col_values=(('external_ids', {'iface-id': '194793c2-2ef3-4aca-967e-4ad828705eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:22:52', 'vm-uuid': '1c601514-628d-4f45-9d06-e8eebc943253'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: INFO os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:52,bridge_name='br-int',has_traffic_filtering=True,id=194793c2-2ef3-4aca-967e-4ad828705eaa,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194793c2-2e')
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=ab3d113c-866b-49e3-8948-c70a8f3e9a27,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3d113c-86') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=ab3d113c-866b-49e3-8948-c70a8f3e9a27,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3d113c-86') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19e9041d-290d-55be-a86e-ce6c93faeb62', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab3d113c-86, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab3d113c-86, col_values=(('qos', UUID('3f36f421-9e81-481f-b94a-004dbe7a3b78')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab3d113c-86, col_values=(('external_ids', {'iface-id': 'ab3d113c-866b-49e3-8948-c70a8f3e9a27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:b9:98', 'vm-uuid': '1c601514-628d-4f45-9d06-e8eebc943253'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: INFO os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=ab3d113c-866b-49e3-8948-c70a8f3e9a27,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3d113c-86')
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:0b:55,bridge_name='br-int',has_traffic_filtering=True,id=eda54889-1294-4127-80f4-f2b9e5ac300c,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda54889-12') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:0b:55,bridge_name='br-int',has_traffic_filtering=True,id=eda54889-1294-4127-80f4-f2b9e5ac300c,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda54889-12') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbf8015e-d97a-5c2e-922a-5aee744f901f', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Updating instance_info_cache with network_info: [{"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Releasing lock "refresh_cache-04e528d5-491a-4914-a1b2-7eee4efc0caf" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Instance network_info: |[{"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] Acquired lock "refresh_cache-04e528d5-491a-4914-a1b2-7eee4efc0caf" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.neutron [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Refreshing network info cache for port b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeda54889-12, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeda54889-12, col_values=(('qos', UUID('27590aff-1af1-48a6-a74a-f6de16e3b2ba')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeda54889-12, col_values=(('external_ids', {'iface-id': 'eda54889-1294-4127-80f4-f2b9e5ac300c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:0b:55', 'vm-uuid': '1c601514-628d-4f45-9d06-e8eebc943253'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: INFO os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:0b:55,bridge_name='br-int',has_traffic_filtering=True,id=eda54889-1294-4127-80f4-f2b9e5ac300c,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda54889-12')
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:62:15,bridge_name='br-int',has_traffic_filtering=True,id=f54431da-f912-4c71-ba33-58340ed9b731,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54431da-f9') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:62:15,bridge_name='br-int',has_traffic_filtering=True,id=f54431da-f912-4c71-ba33-58340ed9b731,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54431da-f9') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e12f0f7-e0e7-5773-8709-f6990d6f6eda', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf54431da-f9, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf54431da-f9, col_values=(('qos', UUID('aa461b79-de01-4e50-b23b-64872b7d4634')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf54431da-f9, col_values=(('external_ids', {'iface-id': 'f54431da-f912-4c71-ba33-58340ed9b731', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:62:15', 'vm-uuid': '1c601514-628d-4f45-9d06-e8eebc943253'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:34 user nova-compute[74080]: INFO os_vif [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:62:15,bridge_name='br-int',has_traffic_filtering=True,id=f54431da-f912-4c71-ba33-58340ed9b731,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54431da-f9')
Oct 16 07:30:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] No BDM found with device name hda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] No VIF found with MAC fa:16:3e:09:4f:ea, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:30:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] No VIF found with MAC fa:16:3e:26:b9:98, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:30:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Using config drive
Oct 16 07:30:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Updated VIF entry in instance network info cache for port b381aba5-0dfe-4d9d-85d3-32f84e65bc78. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Updating instance_info_cache with network_info: [{"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f49c059e-215d-4c64-8535-5a40749602e0 req-c591e672-b336-4450-b045-87c042ff9c87 service nova] Releasing lock "refresh_cache-04e528d5-491a-4914-a1b2-7eee4efc0caf" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Creating config drive at /opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253/disk.config
Oct 16 07:30:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp38rovx6p {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp38rovx6p" returned: 0 in 0.063s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lazy-loading 'flavor' on Instance uuid f055134f-7d13-4ee6-9dfa-11207791a674 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-changed-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Refreshing instance network info cache due to event network-changed-7d924de9-0e44-4edf-992f-d94e6d91a876. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] Acquiring lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] Acquired lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG nova.network.neutron [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Refreshing network info cache for port 7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.140s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:35 user nova-compute[74080]: INFO nova.compute.manager [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Attaching volume 88d2de0f-1b6e-4510-90d1-e4f1094a16bb to /dev/vdb
Oct 16 07:30:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:30:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmlwjHgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:35 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:36 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:36 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99be8ae-de61-4390-b200-714b692952d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:30:36 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8609c00-8c49-454d-90a5-8fa87804fdeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba] added
Oct 16 07:30:36 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c16cb0-4fd1-4a0e-a1c9-fe045b153f55]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1b61f7-250a-4df5-9813-ff743e0b70af]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmlwjHgF {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.network.neutron [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updated VIF entry in instance network info cache for port 7d924de9-0e44-4edf-992f-d94e6d91a876. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.network.neutron [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmlwjHgF" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[241d9e2c-2f24-47bb-a4fb-4605d8a31aca]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmlwjHgF'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b42aa00-2f46-4523-8fb5-ed1fa1a7bbd7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-16ffae32-b519-47ae-a4a1-505e6cf2ba5c req-50d33ff3-32c4-4d25-ade8-c47fd540bad1 service nova] Releasing lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "interface-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "interface-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'flavor' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9535202-fe29-4dc7-93bd-5fadfa4e3c51]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.utils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b37aa4-b582-411d-b895-9980a8d5f2b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9886653a-ad2d-41ff-abc1-58ef71a0d89b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18aa0cc-8576-4687-a5f1-657b4bda738b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260]
Oct 16 07:30:36 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260] successful.
Oct 16 07:30:36 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f4291-06f7-4040-b725-ffd0abc92bf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c25e4bd-b8cd-4b6a-a830-30930ef9dfda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[33796c47-0aad-4c43-bec6-09816c108a5a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e08f89-ff47-4e90-a8eb-5afdf20b9e75]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b862abb-265b-448e-a1e1-9d80d271c5ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:36 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:36 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:36 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.483s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.utils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] <== get_connector_properties: return (237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating existing volume attachment record: 14a8c0a5-22a6-4d90-a7a8-fc90048d4f4e {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dbefd71-6361-4e31-aa5f-073760bef390 req-01b841af-31dd-49ea-b2e6-cc08de15642d service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dbefd71-6361-4e31-aa5f-073760bef390 req-01b841af-31dd-49ea-b2e6-cc08de15642d service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dbefd71-6361-4e31-aa5f-073760bef390 req-01b841af-31dd-49ea-b2e6-cc08de15642d service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6dbefd71-6361-4e31-aa5f-073760bef390 req-01b841af-31dd-49ea-b2e6-cc08de15642d service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-6dbefd71-6361-4e31-aa5f-073760bef390 req-01b841af-31dd-49ea-b2e6-cc08de15642d service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:36 user nova-compute[74080]: WARNING nova.compute.manager [req-6dbefd71-6361-4e31-aa5f-073760bef390 req-01b841af-31dd-49ea-b2e6-cc08de15642d service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 for instance with vm_state building and task_state spawning.
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3b4519-df11-4a2c-8280-3cae6006b5b3]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmlwjHgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'pci_requests' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.objects.base [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Object Instance<3dc7ff51-67ae-4d38-bf1f-e28483e40d5b> lazy-loaded attributes: flavor,pci_requests {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG nova.policy [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b60dc9148587426ebd0b15ddb70a3139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c006491b0f449394c55b7024a19bb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Successfully created port: 1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.546s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== connect_volume: return (1549ms) {'type': 'block', 'scsi_wwn': '23961613166303561', 'path': '/dev/sde'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961613166303561', 'path': '/dev/sde'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG nova.objects.instance [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-f0b97359-bb5d-462d-a5d7-32f31d04f579 req-7363ed78-fa60-481d-80da-7053b9b14767 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f0b97359-bb5d-462d-a5d7-32f31d04f579 req-7363ed78-fa60-481d-80da-7053b9b14767 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f0b97359-bb5d-462d-a5d7-32f31d04f579 req-7363ed78-fa60-481d-80da-7053b9b14767 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f0b97359-bb5d-462d-a5d7-32f31d04f579 req-7363ed78-fa60-481d-80da-7053b9b14767 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-f0b97359-bb5d-462d-a5d7-32f31d04f579 req-7363ed78-fa60-481d-80da-7053b9b14767 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:37 user nova-compute[74080]: WARNING nova.compute.manager [req-f0b97359-bb5d-462d-a5d7-32f31d04f579 req-7363ed78-fa60-481d-80da-7053b9b14767 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa for instance with vm_state building and task_state spawning.
Oct 16 07:30:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:30:37 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:30:37 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:30:37 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:30:37 user nova-compute[74080]:   <serial>3e7ac34b-c1b3-444b-8216-b2ef2babecba</serial>
Oct 16 07:30:37 user nova-compute[74080]: </disk>
Oct 16 07:30:37 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No VIF found with MAC fa:16:3e:24:b7:32, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Successfully updated port: 1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-9b079ab3-5416-43e3-a722-2b32768447d6 req-79f0b8c6-a334-496e-a23f-95659abdc0ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9b079ab3-5416-43e3-a722-2b32768447d6 req-79f0b8c6-a334-496e-a23f-95659abdc0ee service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9b079ab3-5416-43e3-a722-2b32768447d6 req-79f0b8c6-a334-496e-a23f-95659abdc0ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9b079ab3-5416-43e3-a722-2b32768447d6 req-79f0b8c6-a334-496e-a23f-95659abdc0ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-9b079ab3-5416-43e3-a722-2b32768447d6 req-79f0b8c6-a334-496e-a23f-95659abdc0ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:38 user nova-compute[74080]: WARNING nova.compute.manager [req-9b079ab3-5416-43e3-a722-2b32768447d6 req-79f0b8c6-a334-496e-a23f-95659abdc0ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c for instance with vm_state building and task_state spawning.
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquired lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:38 user nova-compute[74080]: WARNING nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 for instance with vm_state building and task_state spawning.
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-changed-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Refreshing instance network info cache due to event network-changed-c9122dc8-4754-4fe0-84cc-9c119964eb16. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquiring lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquired lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG nova.network.neutron [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Refreshing network info cache for port c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-468067f9-5458-4f52-b627-6c2b20ebd9b4 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.165s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.network.neutron [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Updated VIF entry in instance network info cache for port c9122dc8-4754-4fe0-84cc-9c119964eb16. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.network.neutron [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Updating instance_info_cache with network_info: [{"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Releasing lock "refresh_cache-5e0bc1db-0c8e-400b-814c-da5b19e74b91" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:39 user nova-compute[74080]: WARNING nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 for instance with vm_state building and task_state spawning.
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:39 user nova-compute[74080]: WARNING nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 for instance with vm_state building and task_state spawning.
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:39 user nova-compute[74080]: WARNING nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 for instance with vm_state building and task_state spawning.
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:39 user nova-compute[74080]: WARNING nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 for instance with vm_state building and task_state spawning.
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:39 user nova-compute[74080]: WARNING nova.compute.manager [req-32ddc010-b894-4256-ae3f-8babe59b0dd5 req-739387b5-0df7-45c9-8bf4-eefd8116af71 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 for instance with vm_state building and task_state spawning.
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-0d5dbab0-1eae-4807-a2a9-10c18850a687 req-81ebca16-cf53-4565-80bb-5aeeafec9a01 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d5dbab0-1eae-4807-a2a9-10c18850a687 req-81ebca16-cf53-4565-80bb-5aeeafec9a01 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d5dbab0-1eae-4807-a2a9-10c18850a687 req-81ebca16-cf53-4565-80bb-5aeeafec9a01 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d5dbab0-1eae-4807-a2a9-10c18850a687 req-81ebca16-cf53-4565-80bb-5aeeafec9a01 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-0d5dbab0-1eae-4807-a2a9-10c18850a687 req-81ebca16-cf53-4565-80bb-5aeeafec9a01 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:39 user nova-compute[74080]: WARNING nova.compute.manager [req-0d5dbab0-1eae-4807-a2a9-10c18850a687 req-81ebca16-cf53-4565-80bb-5aeeafec9a01 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa for instance with vm_state building and task_state spawning.
Oct 16 07:30:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Releasing lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converting VIF {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG os_vif [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05338e60-2f04-57a6-83b9-a833015fa008', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1616715e-9a, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1616715e-9a, col_values=(('qos', UUID('b7cb6602-8546-4006-87b0-4023d8ded635')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1616715e-9a, col_values=(('external_ids', {'iface-id': '1616715e-9ab5-455f-a830-459d6ea63e83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:52:14', 'vm-uuid': '3dc7ff51-67ae-4d38-bf1f-e28483e40d5b'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: INFO os_vif [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a')
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converting VIF {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] attach device xml: <interface type="ethernet">
Oct 16 07:30:40 user nova-compute[74080]:   <mac address="fa:16:3e:fd:52:14"/>
Oct 16 07:30:40 user nova-compute[74080]:   <model type="virtio"/>
Oct 16 07:30:40 user nova-compute[74080]:   <mtu size="1442"/>
Oct 16 07:30:40 user nova-compute[74080]:   <target dev="tap1616715e-9a"/>
Oct 16 07:30:40 user nova-compute[74080]: </interface>
Oct 16 07:30:40 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-changed-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Refreshing instance network info cache due to event network-changed-1616715e-9ab5-455f-a830-459d6ea63e83. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Acquiring lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Acquired lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.network.neutron [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Refreshing network info cache for port 1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-5661dea2-5d3d-49b0-a80f-f09dec70b02e req-232824a3-b6c3-4567-96f4-39fd3872eee6 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5661dea2-5d3d-49b0-a80f-f09dec70b02e req-232824a3-b6c3-4567-96f4-39fd3872eee6 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5661dea2-5d3d-49b0-a80f-f09dec70b02e req-232824a3-b6c3-4567-96f4-39fd3872eee6 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5661dea2-5d3d-49b0-a80f-f09dec70b02e req-232824a3-b6c3-4567-96f4-39fd3872eee6 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-5661dea2-5d3d-49b0-a80f-f09dec70b02e req-232824a3-b6c3-4567-96f4-39fd3872eee6 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:40 user nova-compute[74080]: WARNING nova.compute.manager [req-5661dea2-5d3d-49b0-a80f-f09dec70b02e req-232824a3-b6c3-4567-96f4-39fd3872eee6 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 for instance with vm_state building and task_state spawning.
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No BDM found with device name hda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No VIF found with MAC fa:16:3e:2f:6f:2b, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:30:41 user nova-compute[74080]:   <nova:package version="0.0.0"/>
Oct 16 07:30:41 user nova-compute[74080]:   <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:30:41 user nova-compute[74080]:   <nova:creationTime>2023-10-16 07:30:41</nova:creationTime>
Oct 16 07:30:41 user nova-compute[74080]:   <nova:flavor name="m1.tiny">
Oct 16 07:30:41 user nova-compute[74080]:     <nova:memory>512</nova:memory>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:disk>1</nova:disk>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:swap>0</nova:swap>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:vcpus>1</nova:vcpus>
Oct 16 07:30:41 user nova-compute[74080]:   </nova:flavor>
Oct 16 07:30:41 user nova-compute[74080]:   <nova:owner>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:30:41 user nova-compute[74080]:   </nova:owner>
Oct 16 07:30:41 user nova-compute[74080]:   <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:30:41 user nova-compute[74080]:   <nova:ports>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:30:41 user nova-compute[74080]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:30:41 user nova-compute[74080]:     </nova:port>
Oct 16 07:30:41 user nova-compute[74080]:     <nova:port uuid="1616715e-9ab5-455f-a830-459d6ea63e83">
Oct 16 07:30:41 user nova-compute[74080]:       <nova:ip type="fixed" address="10.10.10.113" ipVersion="4"/>
Oct 16 07:30:41 user nova-compute[74080]:     </nova:port>
Oct 16 07:30:41 user nova-compute[74080]:   </nova:ports>
Oct 16 07:30:41 user nova-compute[74080]: </nova:instance>
Oct 16 07:30:41 user nova-compute[74080]:  {{(pid=74080) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b000d622-0fef-420a-95b1-71c6ff368bfb tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "interface-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.903s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.network.neutron [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updated VIF entry in instance network info cache for port 1616715e-9ab5-455f-a830-459d6ea63e83. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.network.neutron [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Releasing lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:41 user nova-compute[74080]: WARNING nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c for instance with vm_state building and task_state spawning.
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:41 user nova-compute[74080]: WARNING nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 for instance with vm_state building and task_state spawning.
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:41 user nova-compute[74080]: WARNING nova.compute.manager [req-2439c365-a403-4987-8c9b-7d4da4781880 req-b720ef1a-7b53-459f-822b-2ba61a374d4b service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 for instance with vm_state building and task_state spawning.
Oct 16 07:30:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'flavor' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:30:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance spawned successfully.
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:41 user nova-compute[74080]: INFO nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Took 12.79 seconds to spawn the instance on the hypervisor.
Oct 16 07:30:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:41 user nova-compute[74080]: INFO nova.compute.manager [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Attaching volume a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 to /dev/vdb
Oct 16 07:30:41 user nova-compute[74080]: INFO nova.compute.manager [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Took 60.62 seconds to build instance.
Oct 16 07:30:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4837a4a6-b3db-4859-a0f9-701e6950e324 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "1c601514-628d-4f45-9d06-e8eebc943253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 60.738s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG os_brick.utils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62e2154-227d-422a-b396-8c35680189e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9557a096-1995-4e6c-a8bd-0811710c1e40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2c4ea-78da-4f85-aeae-8b6bffa744da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84611de7-b9ae-446c-9b7b-c463f2622e7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:42 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a9f5b-5951-4aeb-8138-ead086b52a63]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG os_brick.utils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating existing volume attachment record: a681cf56-98db-4d2a-ab5b-b13c4795a9fc {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:42 user nova-compute[74080]: WARNING nova.compute.manager [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received unexpected event network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 for instance with vm_state active and task_state None.
Oct 16 07:30:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:42 user nova-compute[74080]: WARNING nova.compute.manager [req-da26614a-42cf-4ffb-9e05-21330ef89d6c req-f25c666d-aca6-47ba-8f64-ed49db80843b service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received unexpected event network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 for instance with vm_state active and task_state None.
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "01d16a73-705e-4723-b74c-bc2581f1afb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:30:43 user nova-compute[74080]: INFO nova.compute.claims [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Claim successful on node user
Oct 16 07:30:43 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:30:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:30:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:30:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG nova.policy [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbfbcc052d274a2b85276bf7c12e8233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998dad27b18a4a15a4563815aa57cb72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:30:44 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Creating image(s)
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "/opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk 1073741824" returned: 0 in 0.068s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:44 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.198s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Cannot resize image /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Ensure instance console log exists: /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG nova.network.neutron [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Successfully created port: 095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG nova.network.neutron [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Successfully updated port: 095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquired lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:45 user nova-compute[74080]: DEBUG nova.network.neutron [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-changed-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Refreshing instance network info cache due to event network-changed-095a5de1-67c7-45aa-82eb-3f62a5bccdd0. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] Acquiring lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Updating instance_info_cache with network_info: [{"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Releasing lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Instance network_info: |[{"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] Acquired lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Refreshing network info cache for port 095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Start _get_guest_xml network_info=[{"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:30:46 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:30:46 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1387690353',display_name='tempest-AttachVolumeNegativeTest-server-1387690353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1387690353',id=10,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz5XYWtr4Lk/kYbebbuCJ/HNy17bCQ0Yjs+WILyFF+PR9U3eymjmg1WY5xT5dom6xOMRrwMSeDrCC3aTY0xyLsswUjw425BTwP2vj+Hi6m0S/XqEJdLpJ3c3fdrJdHGbw==',key_name='tempest-keypair-1318532778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-pif9apqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=01d16a73-705e-4723-b74c-bc2581f1afb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d0:8c,bridge_name='br-int',has_traffic_filtering=True,id=095a5de1-67c7-45aa-82eb-3f62a5bccdd0,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095a5de1-67') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.objects.instance [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'pci_devices' on Instance uuid 01d16a73-705e-4723-b74c-bc2581f1afb7 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:30:46 user nova-compute[74080]:   <uuid>01d16a73-705e-4723-b74c-bc2581f1afb7</uuid>
Oct 16 07:30:46 user nova-compute[74080]:   <name>instance-0000000a</name>
Oct 16 07:30:46 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:30:46 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:30:46 user nova-compute[74080]:   <metadata>
Oct 16 07:30:46 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:30:46 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:30:46 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1387690353</nova:name>
Oct 16 07:30:46 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:30:46</nova:creationTime>
Oct 16 07:30:46 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:30:46 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:30:46 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:30:46 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:30:46 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:30:46 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:30:46 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:30:46 user nova-compute[74080]:       <nova:owner>
Oct 16 07:30:46 user nova-compute[74080]:         <nova:user uuid="bbfbcc052d274a2b85276bf7c12e8233">tempest-AttachVolumeNegativeTest-1751015165-project-member</nova:user>
Oct 16 07:30:46 user nova-compute[74080]:         <nova:project uuid="998dad27b18a4a15a4563815aa57cb72">tempest-AttachVolumeNegativeTest-1751015165</nova:project>
Oct 16 07:30:46 user nova-compute[74080]:       </nova:owner>
Oct 16 07:30:46 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:30:46 user nova-compute[74080]:       <nova:ports>
Oct 16 07:30:46 user nova-compute[74080]:         <nova:port uuid="095a5de1-67c7-45aa-82eb-3f62a5bccdd0">
Oct 16 07:30:46 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 07:30:46 user nova-compute[74080]:         </nova:port>
Oct 16 07:30:46 user nova-compute[74080]:       </nova:ports>
Oct 16 07:30:46 user nova-compute[74080]:     </nova:instance>
Oct 16 07:30:46 user nova-compute[74080]:   </metadata>
Oct 16 07:30:46 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:30:46 user nova-compute[74080]:     <system>
Oct 16 07:30:46 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:30:46 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:30:46 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:30:46 user nova-compute[74080]:       <entry name="serial">01d16a73-705e-4723-b74c-bc2581f1afb7</entry>
Oct 16 07:30:46 user nova-compute[74080]:       <entry name="uuid">01d16a73-705e-4723-b74c-bc2581f1afb7</entry>
Oct 16 07:30:46 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:30:46 user nova-compute[74080]:     </system>
Oct 16 07:30:46 user nova-compute[74080]:   </sysinfo>
Oct 16 07:30:46 user nova-compute[74080]:   <os>
Oct 16 07:30:46 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:30:46 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:30:46 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:30:46 user nova-compute[74080]:   </os>
Oct 16 07:30:46 user nova-compute[74080]:   <features>
Oct 16 07:30:46 user nova-compute[74080]:     <acpi/>
Oct 16 07:30:46 user nova-compute[74080]:     <apic/>
Oct 16 07:30:46 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:30:46 user nova-compute[74080]:   </features>
Oct 16 07:30:46 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:30:46 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:30:46 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:30:46 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:30:46 user nova-compute[74080]:   </clock>
Oct 16 07:30:46 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:30:46 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:30:46 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:30:46 user nova-compute[74080]:   </cpu>
Oct 16 07:30:46 user nova-compute[74080]:   <devices>
Oct 16 07:30:46 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:30:46 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:30:46 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk"/>
Oct 16 07:30:46 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:30:46 user nova-compute[74080]:     </disk>
Oct 16 07:30:46 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:30:46 user nova-compute[74080]:       <mac address="fa:16:3e:58:d0:8c"/>
Oct 16 07:30:46 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:46 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:30:46 user nova-compute[74080]:       <target dev="tap095a5de1-67"/>
Oct 16 07:30:46 user nova-compute[74080]:     </interface>
Oct 16 07:30:46 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:30:46 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/console.log" append="off"/>
Oct 16 07:30:46 user nova-compute[74080]:     </serial>
Oct 16 07:30:46 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:30:46 user nova-compute[74080]:     <video>
Oct 16 07:30:46 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:30:46 user nova-compute[74080]:     </video>
Oct 16 07:30:46 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:30:46 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:30:46 user nova-compute[74080]:     </rng>
Oct 16 07:30:46 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:30:46 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:30:46 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:30:46 user nova-compute[74080]:     </memballoon>
Oct 16 07:30:46 user nova-compute[74080]:   </devices>
Oct 16 07:30:46 user nova-compute[74080]: </domain>
Oct 16 07:30:46 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1387690353',display_name='tempest-AttachVolumeNegativeTest-server-1387690353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1387690353',id=10,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz5XYWtr4Lk/kYbebbuCJ/HNy17bCQ0Yjs+WILyFF+PR9U3eymjmg1WY5xT5dom6xOMRrwMSeDrCC3aTY0xyLsswUjw425BTwP2vj+Hi6m0S/XqEJdLpJ3c3fdrJdHGbw==',key_name='tempest-keypair-1318532778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-pif9apqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=01d16a73-705e-4723-b74c-bc2581f1afb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d0:8c,bridge_name='br-int',has_traffic_filtering=True,id=095a5de1-67c7-45aa-82eb-3f62a5bccdd0,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095a5de1-67') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG os_vif [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d0:8c,bridge_name='br-int',has_traffic_filtering=True,id=095a5de1-67c7-45aa-82eb-3f62a5bccdd0,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095a5de1-67') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a796e66-3ade-5b81-af30-5dfdcd1b2d17', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap095a5de1-67, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap095a5de1-67, col_values=(('qos', UUID('f1d2da31-4f52-47e9-80f0-d138c5e57fdd')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap095a5de1-67, col_values=(('external_ids', {'iface-id': '095a5de1-67c7-45aa-82eb-3f62a5bccdd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:d0:8c', 'vm-uuid': '01d16a73-705e-4723-b74c-bc2581f1afb7'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:46 user nova-compute[74080]: INFO os_vif [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d0:8c,bridge_name='br-int',has_traffic_filtering=True,id=095a5de1-67c7-45aa-82eb-3f62a5bccdd0,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095a5de1-67')
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No VIF found with MAC fa:16:3e:58:d0:8c, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Updated VIF entry in instance network info cache for port 095a5de1-67c7-45aa-82eb-3f62a5bccdd0. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Updating instance_info_cache with network_info: [{"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b581fc7e-0807-4107-a22f-4cb9a09ee8db req-b17bc9e7-fed9-40fd-946e-bbcaf27b51d2 service nova] Releasing lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-5fae28b8-c145-487a-9c8e-7083c917e0a6 req-4747aa6e-ce7d-4dd5-94ba-a275e715222a service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5fae28b8-c145-487a-9c8e-7083c917e0a6 req-4747aa6e-ce7d-4dd5-94ba-a275e715222a service nova] Acquiring lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5fae28b8-c145-487a-9c8e-7083c917e0a6 req-4747aa6e-ce7d-4dd5-94ba-a275e715222a service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5fae28b8-c145-487a-9c8e-7083c917e0a6 req-4747aa6e-ce7d-4dd5-94ba-a275e715222a service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-5fae28b8-c145-487a-9c8e-7083c917e0a6 req-4747aa6e-ce7d-4dd5-94ba-a275e715222a service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] No waiting events found dispatching network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:48 user nova-compute[74080]: WARNING nova.compute.manager [req-5fae28b8-c145-487a-9c8e-7083c917e0a6 req-4747aa6e-ce7d-4dd5-94ba-a275e715222a service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received unexpected event network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 for instance with vm_state building and task_state spawning.
Oct 16 07:30:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-changed-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Refreshing instance network info cache due to event network-changed-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] Acquiring lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] Acquired lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Refreshing network info cache for port d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Updated VIF entry in instance network info cache for port d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Updating instance_info_cache with network_info: [{"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:30:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3a40a123-c55b-402e-838a-1958826439db req-49f34299-0b72-4026-ad39-6fe9bb67b355 service nova] Releasing lock "refresh_cache-34cb3aed-3c32-460c-adb1-ab9c176be198" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-0b6aecd8-49f7-4104-9d4d-59cab8d237d5 req-0b9c9468-95dd-4fe2-a82c-949ecfbdfdf6 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0b6aecd8-49f7-4104-9d4d-59cab8d237d5 req-0b9c9468-95dd-4fe2-a82c-949ecfbdfdf6 service nova] Acquiring lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0b6aecd8-49f7-4104-9d4d-59cab8d237d5 req-0b9c9468-95dd-4fe2-a82c-949ecfbdfdf6 service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0b6aecd8-49f7-4104-9d4d-59cab8d237d5 req-0b9c9468-95dd-4fe2-a82c-949ecfbdfdf6 service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-0b6aecd8-49f7-4104-9d4d-59cab8d237d5 req-0b9c9468-95dd-4fe2-a82c-949ecfbdfdf6 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] No waiting events found dispatching network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:30:50 user nova-compute[74080]: WARNING nova.compute.manager [req-0b6aecd8-49f7-4104-9d4d-59cab8d237d5 req-0b9c9468-95dd-4fe2-a82c-949ecfbdfdf6 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received unexpected event network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 for instance with vm_state building and task_state spawning.
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:30:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Instance spawned successfully.
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:30:50 user nova-compute[74080]: INFO nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Took 6.44 seconds to spawn the instance on the hypervisor.
Oct 16 07:30:50 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:30:50 user nova-compute[74080]: INFO nova.compute.manager [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Took 7.91 seconds to build instance.
Oct 16 07:30:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41151d71-ba07-4383-b1e4-a123f6d99d51 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.041s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaFTzfDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:51 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:51 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:51 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4ce01-c763-4d47-8856-3f27755a5cb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:30:51 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc07ad68-30f8-4526-9ef2-2b0d3f4d3f41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7] added
Oct 16 07:30:51 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3992a4e-cfb2-4e0e-9ad9-89d424c07d9d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca2cb1-f706-4295-a99c-8b4f273bd843]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaFTzfDZ {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaFTzfDZ" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f6ada0-80f7-46b0-8ef2-c61812d65d4d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XaFTzfDZ'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f93c95-baf8-4a64-8e3e-67ac5f97d18c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[02491c69-b456-44a0-b247-6a3b16e37936]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a6017-d231-4d5a-b5ab-5af8c30231a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260]
Oct 16 07:30:52 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260] successful.
Oct 16 07:30:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[089130b8-0ccf-43c8-b3d3-beca39cfaa74]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[902523ee-4958-4098-a842-c678152e8935]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:52 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:30:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[80691c50-b67f-4bd6-8572-dafaa29138f3]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaFTzfDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG nova.objects.instance [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lazy-loading 'flavor' on Instance uuid 34cb3aed-3c32-460c-adb1-ab9c176be198 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG nova.objects.instance [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lazy-loading 'flavor' on Instance uuid 5e0bc1db-0c8e-400b-814c-da5b19e74b91 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23634333139653661', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634333139653661', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG nova.objects.instance [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lazy-loading 'flavor' on Instance uuid 9ca2ec50-7468-41d7-9bab-5021f4875604 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:30:53 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:30:53 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:30:53 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:30:53 user nova-compute[74080]:   <serial>05969d64-02be-4924-bf37-7d6cb9366cd7</serial>
Oct 16 07:30:53 user nova-compute[74080]: </disk>
Oct 16 07:30:53 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:53 user nova-compute[74080]: INFO nova.compute.manager [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Attaching volume dd715153-3376-4df2-b673-b59584605209 to /dev/vdb
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:30:53 user nova-compute[74080]: INFO nova.compute.manager [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Attaching volume 28a4ffc9-c174-4b6a-931f-adbb8282f99c to /dev/sdc
Oct 16 07:30:53 user nova-compute[74080]: DEBUG os_brick.utils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c34294-b5fc-4065-86e5-03a383143210]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ca3e45-43b6-476d-b2c4-5d1f09874bd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[de184ab7-4712-40ff-9f1a-99414a7bf80a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7435d57f-cb32-4130-996b-8baa47148c93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.utils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[804991df-8b7c-4a64-abcc-ae8be26e8c21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:54 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[444a5396-16f6-46ef-9679-ceca024754c9]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.utils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Updating existing volume attachment record: 3e3292a4-a72a-4ccb-a455-f432e4ff7c91 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.utils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] No VIF found with MAC fa:16:3e:cc:e0:2a, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45f9dad-a93a-463f-a6ff-c65bbcfe8978]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27397094-cb26-4b53-8fe6-43b75d3708f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcba0ad-d457-490a-8488-89269e4a2ff5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dfe566-db42-495f-add7-1f88801d1d4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecded0b1-905e-4f07-82fc-9eed6a18cc61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58cb34a-a99c-4b38-b00c-819f9bb72f9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:54 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e0770b-2fd2-4820-a757-55b0bc520659]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce19c0-cf65-4771-a81d-c68d72c6973b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.utils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Updating existing volume attachment record: 0038f368-f659-4b47-a9e6-fabe1b1503cd {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:30:54 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:30:54 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1445cc5-46e8-4588-bb11-7d88a4b770db]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG os_brick.utils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:54 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Updating existing volume attachment record: e350d9bc-4a19-4053-9eb7-76bd0f9bd580 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvoRsBNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:30:55 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:55 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:30:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:30:55 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:30:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9d0068-8c9c-499b-8803-6e780d561c5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:30:55 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f5ffb5-51a3-42c7-9092-51d5b8bd9565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb] added
Oct 16 07:30:55 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a29f7-b0df-4189-89ee-f920b105cf5f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.101s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c227d1-0a3c-409d-bec9-ccbbf853bb39]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvoRsBNr {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvoRsBNr" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b152860e-b97b-472a-b6f5-4ad08a07a668]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SvoRsBNr'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-34a17de9-c9fa-4578-b39b-6848f62cb43f tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.443s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c259e033-60ee-4b0d-b2b5-9f56669e6a45]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dafb8e-33cf-4f10-8587-af8b1dcfa456]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038e567-4cb1-4ff0-baa2-71ef08fb5ab3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260]
Oct 16 07:30:56 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260] successful.
Oct 16 07:30:56 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9851532a-93d0-4e43-b46c-5980011900fb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[275e5299-4e6f-4b2d-911f-79a39726a083]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:30:56 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:30:56 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:30:56 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f14d571-e290-40ff-8eb6-df93b6c2a7ba]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvoRsBNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:30:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26432646532623537', 'path': '/dev/sdg'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432646532623537', 'path': '/dev/sdg'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG nova.objects.instance [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lazy-loading 'flavor' on Instance uuid f055134f-7d13-4ee6-9dfa-11207791a674 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:30:57 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:30:57 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:30:57 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:30:57 user nova-compute[74080]:   <serial>88d2de0f-1b6e-4510-90d1-e4f1094a16bb</serial>
Oct 16 07:30:57 user nova-compute[74080]: </disk>
Oct 16 07:30:57 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:30:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] No VIF found with MAC fa:16:3e:aa:99:04, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:31:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQpsRSFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:11 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:11 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:11 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f97ce2-fe0d-40bf-aba4-b9f03205797c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:31:11 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[65303742-58be-4247-a740-4d4336d91074]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548] added
Oct 16 07:31:11 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.051s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca0085d-a695-49b1-b652-6549a8e3dd67]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f0a17-4666-42f0-ac8f-da39eafea46e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQpsRSFu {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQpsRSFu" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0236f2-299f-4e7d-9cb3-12630cd052fd]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQpsRSFu'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b4eb6d-4627-4370-b42e-43a37a83f447]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a6ea2d-1e6d-4cb3-a7a3-12017a2a5b77]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf454ef-62dd-418c-abfd-f47622a2a885]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260]
Oct 16 07:31:11 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:11 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b023022f-5074-4a46-b1ec-9b261d7ebfa5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[705574ff-2639-4e87-8c2b-c36849611b68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:11 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:11 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a367cda-3baf-47d4-b59c-62eee74074ad]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:31:11 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQpsRSFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:31:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:12 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:12 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23638383530313566', 'path': '/dev/sdh'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638383530313566', 'path': '/dev/sdh'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:31:12 user nova-compute[74080]: DEBUG nova.objects.instance [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'flavor' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:31:12 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:12 user nova-compute[74080]:   <source dev="/dev/sdh"/>
Oct 16 07:31:12 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:12 user nova-compute[74080]:   <serial>a0ae96b0-9b28-42d5-b6f7-f6b9c366f548</serial>
Oct 16 07:31:12 user nova-compute[74080]: </disk>
Oct 16 07:31:12 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No BDM found with device name hda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] No VIF found with MAC fa:16:3e:2f:6f:2b, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updating instance_info_cache with network_info: [{"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a9eb6806-a147-48bc-a36b-228179060c9b tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.600s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-145755d1-37f6-44e1-a50b-0492a7760486 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.637s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:31:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Creating image(s)
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Ensure instance console log exists: /opt/stack/data/nova/instances/04e528d5-491a-4914-a1b2-7eee4efc0caf/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Start _get_guest_xml network_info=[{"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3e3292a4-a72a-4ccb-a455-f432e4ff7c91', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSBtRgkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '04e528d5-491a-4914-a1b2-7eee4efc0caf', 'attached_at': '', 'detached_at': '', 'volume_id': '04f4792b-47f0-4f4e-a60d-70ae11e957ab', 'serial': '04f4792b-47f0-4f4e-a60d-70ae11e957ab'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:31:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:31:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSBtRgkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:14 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[98358765-0b89-427f-abf4-37aa37b44bca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:31:14 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd5bcc4-b77a-4810-ab8c-590361394786]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab] added
Oct 16 07:31:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12e87f0-7e1a-45de-a32e-a0da6164f02f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a699ded-431d-4ba0-86d7-269f3ae595f7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VSBtRgkv {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VSBtRgkv" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef9b36c-fed7-4223-8003-5d2a0f95e684]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VSBtRgkv'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[02da0031-2fff-4e08-9c5c-a19f7b014d14]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:15 user nova-compute[74080]: INFO nova.compute.manager [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Terminating instance
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG nova.compute.manager [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ce07f-621e-442c-b7ea-847bae8753a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145102b-6b86-436d-8904-1023841a06b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260]
Oct 16 07:31:15 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[765fa427-4dfd-49f5-b94b-18eb5a8874d7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.116s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b660e1-9a56-472a-8018-bf072362b4cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:15 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.509s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca1974-8e19-4342-aa6a-155e5ad021f1]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSBtRgkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOZiGAXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:15 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-e2dd21c7-c3e9-4236-b925-72ac3fa3be64 req-f22e72f4-ea4c-4e79-a878-c433de3d07df service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received event network-vif-unplugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e2dd21c7-c3e9-4236-b925-72ac3fa3be64 req-f22e72f4-ea4c-4e79-a878-c433de3d07df service nova] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e2dd21c7-c3e9-4236-b925-72ac3fa3be64 req-f22e72f4-ea4c-4e79-a878-c433de3d07df service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e2dd21c7-c3e9-4236-b925-72ac3fa3be64 req-f22e72f4-ea4c-4e79-a878-c433de3d07df service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-e2dd21c7-c3e9-4236-b925-72ac3fa3be64 req-f22e72f4-ea4c-4e79-a878-c433de3d07df service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] No waiting events found dispatching network-vif-unplugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-e2dd21c7-c3e9-4236-b925-72ac3fa3be64 req-f22e72f4-ea4c-4e79-a878-c433de3d07df service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received event network-vif-unplugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Instance destroyed successfully.
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.objects.instance [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lazy-loading 'resources' on Instance uuid 9ca2ec50-7468-41d7-9bab-5021f4875604 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-505035985',display_name='tempest-DeleteServersTestJSON-server-505035985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-505035985',id=1,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b292828eb6e14986b6a0d34b1d556c08',ramdisk_id='',reservation_id='r-apqgqfa5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1269385163',owner_user_name='tempest-DeleteServersTestJSON-1269385163-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:32Z,user_data=None,user_id='8e57df7c833849328ba240aa1ce74a68',uuid=9ca2ec50-7468-41d7-9bab-5021f4875604,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Converting VIF {"id": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "address": "fa:16:3e:cc:e0:2a", "network": {"id": "8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-664507807-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b292828eb6e14986b6a0d34b1d556c08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa39c6a94-fe", "ovs_interfaceid": "a39c6a94-feb8-46ca-9b49-195ba8b75d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e0:2a,bridge_name='br-int',has_traffic_filtering=True,id=a39c6a94-feb8-46ca-9b49-195ba8b75d91,network=Network(8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39c6a94-fe') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_vif [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e0:2a,bridge_name='br-int',has_traffic_filtering=True,id=a39c6a94-feb8-46ca-9b49-195ba8b75d91,network=Network(8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39c6a94-fe') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa39c6a94-fe, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9b498a7-5a06-4c94-959e-2c4c11b2e84c) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:31:16 user nova-compute[74080]: INFO os_vif [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:e0:2a,bridge_name='br-int',has_traffic_filtering=True,id=a39c6a94-feb8-46ca-9b49-195ba8b75d91,network=Network(8c100ad8-8a4b-4a79-80d6-5f05f4cd82d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa39c6a94-fe')
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaFTzfDZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:16 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.613s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== connect_volume: return (1616ms) {'type': 'block', 'scsi_wwn': '26230333334643133', 'path': '/dev/sdi'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230333334643133', 'path': '/dev/sdi'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.875s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:16 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:16 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d17dde-2d70-4531-9606-09c72f5b22df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:31:16 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-521487713',display_name='tempest-TestVolumeBootPattern-server-521487713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-521487713',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-8kcmg9xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:30:32Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=04e528d5-491a-4914-a1b2-7eee4efc0caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:92:06,bridge_name='br-int',has_traffic_filtering=True,id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381aba5-0d') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.objects.instance [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'pci_devices' on Instance uuid 04e528d5-491a-4914-a1b2-7eee4efc0caf {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24305b2-f6cb-4996-b673-cacf7ea4d607]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209] added
Oct 16 07:31:16 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:31:16 user nova-compute[74080]:   <uuid>04e528d5-491a-4914-a1b2-7eee4efc0caf</uuid>
Oct 16 07:31:16 user nova-compute[74080]:   <name>instance-00000009</name>
Oct 16 07:31:16 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:31:16 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:31:16 user nova-compute[74080]:   <metadata>
Oct 16 07:31:16 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:31:16 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:31:16 user nova-compute[74080]:       <nova:name>tempest-TestVolumeBootPattern-server-521487713</nova:name>
Oct 16 07:31:16 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:31:14</nova:creationTime>
Oct 16 07:31:16 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:31:16 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:31:16 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:31:16 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:31:16 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:31:16 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:31:16 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:31:16 user nova-compute[74080]:       <nova:owner>
Oct 16 07:31:16 user nova-compute[74080]:         <nova:user uuid="33b58ae309d047548ebf29684db6037e">tempest-TestVolumeBootPattern-959199453-project-member</nova:user>
Oct 16 07:31:16 user nova-compute[74080]:         <nova:project uuid="c8b70039a31c47f39f7bf1b01b4e6e79">tempest-TestVolumeBootPattern-959199453</nova:project>
Oct 16 07:31:16 user nova-compute[74080]:       </nova:owner>
Oct 16 07:31:16 user nova-compute[74080]:       <nova:ports>
Oct 16 07:31:16 user nova-compute[74080]:         <nova:port uuid="b381aba5-0dfe-4d9d-85d3-32f84e65bc78">
Oct 16 07:31:16 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 07:31:16 user nova-compute[74080]:         </nova:port>
Oct 16 07:31:16 user nova-compute[74080]:       </nova:ports>
Oct 16 07:31:16 user nova-compute[74080]:     </nova:instance>
Oct 16 07:31:16 user nova-compute[74080]:   </metadata>
Oct 16 07:31:16 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:31:16 user nova-compute[74080]:     <system>
Oct 16 07:31:16 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:31:16 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:31:16 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:31:16 user nova-compute[74080]:       <entry name="serial">04e528d5-491a-4914-a1b2-7eee4efc0caf</entry>
Oct 16 07:31:16 user nova-compute[74080]:       <entry name="uuid">04e528d5-491a-4914-a1b2-7eee4efc0caf</entry>
Oct 16 07:31:16 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:31:16 user nova-compute[74080]:     </system>
Oct 16 07:31:16 user nova-compute[74080]:   </sysinfo>
Oct 16 07:31:16 user nova-compute[74080]:   <os>
Oct 16 07:31:16 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:31:16 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:31:16 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:31:16 user nova-compute[74080]:   </os>
Oct 16 07:31:16 user nova-compute[74080]:   <features>
Oct 16 07:31:16 user nova-compute[74080]:     <acpi/>
Oct 16 07:31:16 user nova-compute[74080]:     <apic/>
Oct 16 07:31:16 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:31:16 user nova-compute[74080]:   </features>
Oct 16 07:31:16 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:31:16 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:31:16 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:31:16 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:31:16 user nova-compute[74080]:   </clock>
Oct 16 07:31:16 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:31:16 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:31:16 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:31:16 user nova-compute[74080]:   </cpu>
Oct 16 07:31:16 user nova-compute[74080]:   <devices>
Oct 16 07:31:16 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:31:16 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:16 user nova-compute[74080]:       <source dev="/dev/sdi"/>
Oct 16 07:31:16 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:31:16 user nova-compute[74080]:       <serial>04f4792b-47f0-4f4e-a60d-70ae11e957ab</serial>
Oct 16 07:31:16 user nova-compute[74080]:     </disk>
Oct 16 07:31:16 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:31:16 user nova-compute[74080]:       <mac address="fa:16:3e:dd:92:06"/>
Oct 16 07:31:16 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:31:16 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:31:16 user nova-compute[74080]:       <target dev="tapb381aba5-0d"/>
Oct 16 07:31:16 user nova-compute[74080]:     </interface>
Oct 16 07:31:16 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:31:16 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/04e528d5-491a-4914-a1b2-7eee4efc0caf/console.log" append="off"/>
Oct 16 07:31:16 user nova-compute[74080]:     </serial>
Oct 16 07:31:16 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:31:16 user nova-compute[74080]:     <video>
Oct 16 07:31:16 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:31:16 user nova-compute[74080]:     </video>
Oct 16 07:31:16 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:31:16 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:31:16 user nova-compute[74080]:     </rng>
Oct 16 07:31:16 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:31:16 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:31:16 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:31:16 user nova-compute[74080]:     </memballoon>
Oct 16 07:31:16 user nova-compute[74080]:   </devices>
Oct 16 07:31:16 user nova-compute[74080]: </domain>
Oct 16 07:31:16 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-521487713',display_name='tempest-TestVolumeBootPattern-server-521487713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-521487713',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-8kcmg9xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:30:32Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=04e528d5-491a-4914-a1b2-7eee4efc0caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:92:06,bridge_name='br-int',has_traffic_filtering=True,id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381aba5-0d') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_vif [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:92:06,bridge_name='br-int',has_traffic_filtering=True,id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381aba5-0d') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ab1356-c16e-4a9d-92d4-4478ddb9308d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61fd4a38-fa23-5142-ad63-d25554542ca1', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb381aba5-0d, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb381aba5-0d, col_values=(('qos', UUID('8b03685a-8cb6-4e05-88fa-0d55ef728ca3')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb381aba5-0d, col_values=(('external_ids', {'iface-id': 'b381aba5-0dfe-4d9d-85d3-32f84e65bc78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:92:06', 'vm-uuid': '04e528d5-491a-4914-a1b2-7eee4efc0caf'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b67d3f2-5560-4877-b77b-6a27e85ad5b6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOZiGAXJ {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:16 user nova-compute[74080]: INFO os_vif [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:92:06,bridge_name='br-int',has_traffic_filtering=True,id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381aba5-0d')
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOZiGAXJ" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da17e26-8b66-41ed-9a1f-8784db3a56e7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tOZiGAXJ'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d03b8-60ee-40a6-9d3b-903aabb886bf]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.594s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "87991349-e339-4fcf-b4ef-52936a931511" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a24705-d80e-4342-bd25-8167dea6579f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:31:17 user nova-compute[74080]: INFO nova.compute.manager [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Detaching volume 88d2de0f-1b6e-4510-90d1-e4f1094a16bb
Oct 16 07:31:17 user nova-compute[74080]: INFO nova.compute.manager [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Detaching volume a0ae96b0-9b28-42d5-b6f7-f6b9c366f548
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No VIF found with MAC fa:16:3e:dd:92:06, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a0346f-a6ab-43be-aaf4-d5e3c7147d12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260]
Oct 16 07:31:17 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: INFO nova.virt.block_device [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Attempting to driver detach volume 88d2de0f-1b6e-4510-90d1-e4f1094a16bb from mountpoint /dev/vdb
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c080e-ce78-4aa7-acb8-cdd5d0a7d24d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Attempting to detach device vdb from instance f055134f-7d13-4ee6-9dfa-11207791a674 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:17 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:17 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:31:17 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:17 user nova-compute[74080]:   <serial>88d2de0f-1b6e-4510-90d1-e4f1094a16bb</serial>
Oct 16 07:31:17 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:31:17 user nova-compute[74080]: </disk>
Oct 16 07:31:17 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:17 user nova-compute[74080]: INFO nova.virt.block_device [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Attempting to driver detach volume a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 from mountpoint /dev/vdb
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:31:17 user nova-compute[74080]: INFO nova.compute.claims [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Claim successful on node user
Oct 16 07:31:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Successfully detached device vdb from instance f055134f-7d13-4ee6-9dfa-11207791a674 from the persistent domain config.
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f055134f-7d13-4ee6-9dfa-11207791a674 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:17 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:17 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:31:17 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:17 user nova-compute[74080]:   <serial>88d2de0f-1b6e-4510-90d1-e4f1094a16bb</serial>
Oct 16 07:31:17 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:31:17 user nova-compute[74080]: </disk>
Oct 16 07:31:17 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df9d931-432f-48ef-bbb2-f739e579ec10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:17 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.762s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Attempting to detach device vdb from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:17 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:17 user nova-compute[74080]:   <source dev="/dev/sdh"/>
Oct 16 07:31:17 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:17 user nova-compute[74080]:   <serial>a0ae96b0-9b28-42d5-b6f7-f6b9c366f548</serial>
Oct 16 07:31:17 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 07:31:17 user nova-compute[74080]: </disk>
Oct 16 07:31:17 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[143476cb-b388-441b-936c-f44278415ecf]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOZiGAXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:31:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully detached device vdb from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the persistent domain config.
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:17 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:17 user nova-compute[74080]:   <source dev="/dev/sdh"/>
Oct 16 07:31:17 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:17 user nova-compute[74080]:   <serial>a0ae96b0-9b28-42d5-b6f7-f6b9c366f548</serial>
Oct 16 07:31:17 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 07:31:17 user nova-compute[74080]: </disk>
Oct 16 07:31:17 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-e9ffd4a9-2f8b-40de-82c7-c95669a58837 req-481963b2-66f0-447d-9625-3e42b300db9c service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received event network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9ffd4a9-2f8b-40de-82c7-c95669a58837 req-481963b2-66f0-447d-9625-3e42b300db9c service nova] Acquiring lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9ffd4a9-2f8b-40de-82c7-c95669a58837 req-481963b2-66f0-447d-9625-3e42b300db9c service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9ffd4a9-2f8b-40de-82c7-c95669a58837 req-481963b2-66f0-447d-9625-3e42b300db9c service nova] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-e9ffd4a9-2f8b-40de-82c7-c95669a58837 req-481963b2-66f0-447d-9625-3e42b300db9c service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] No waiting events found dispatching network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:17 user nova-compute[74080]: WARNING nova.compute.manager [req-e9ffd4a9-2f8b-40de-82c7-c95669a58837 req-481963b2-66f0-447d-9625-3e42b300db9c service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received unexpected event network-vif-plugged-a39c6a94-feb8-46ca-9b49-195ba8b75d91 for instance with vm_state active and task_state deleting.
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f055134f-7d13-4ee6-9dfa-11207791a674 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:31:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:31:18 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:31:18 user nova-compute[74080]: INFO nova.virt.block_device [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Booting with volume ef9e8398-a4e0-4fea-b500-4e4344ef77e3 at /dev/vda
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.policy [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aa035c155654d148bc7a99d7334c302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81c8059ab6ba44de94098ef28e33cfd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.utils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1bd237-e420-4811-8ff8-ec4852364100]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b894e1-50ee-46e8-b620-3c810fea8a6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daede92-b34f-4d40-9240-de10a9e12627]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5557b99-09f5-4430-b4ea-7edece119130]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.877s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] <== connect_volume: return (2753ms) {'type': 'block', 'scsi_wwn': '23233623731386665', 'path': '/dev/sdj'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233623731386665', 'path': '/dev/sdj'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.168s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lazy-loading 'flavor' on Instance uuid 34cb3aed-3c32-460c-adb1-ab9c176be198 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:18 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bbe3e4-7942-49ee-a88f-8fdb48daec73]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.utils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating existing volume attachment record: 8070d657-e2b7-4115-b4c0-ba85859696af {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b029e70-c80e-4df1-a539-022198c678ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:31:18 user nova-compute[74080]: No targets found.
Oct 16 07:31:18 user nova-compute[74080]: iSNS:
Oct 16 07:31:18 user nova-compute[74080]: No targets found.
Oct 16 07:31:18 user nova-compute[74080]: STATIC:
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:31:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:18 user nova-compute[74080]: FIRMWARE:
Oct 16 07:31:18 user nova-compute[74080]: No targets found.
Oct 16 07:31:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:31:18 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:31:18 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] attach device xml: <disk type="block" device="disk">
Oct 16 07:31:18 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:18 user nova-compute[74080]:   <source dev="/dev/sdj"/>
Oct 16 07:31:18 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:18 user nova-compute[74080]:   <serial>dd715153-3376-4df2-b673-b59584605209</serial>
Oct 16 07:31:18 user nova-compute[74080]: </disk>
Oct 16 07:31:18 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05134fd7-1ed0-4967-a7dd-e0a29b8f12de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dccf4de-42b4-4236-8789-2f891e84646a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:18 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7cc0eff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7'): ({'sdf'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Removing single pathed devices sdf {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b75ef2-9f3c-4a77-90c9-310b02d6054a]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347225e-bda4-4217-8c87-98c49aebf495]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Flushing IO for device /dev/sdf {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[25512351-5caa-4ce3-b231-0a8e58ebdf7e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4a0edc-7536-456b-8f05-413db03a05db]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f6ed46-c02b-4213-925e-84dfa30a879f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[880391cc-d879-4322-8fcd-dc7bd8f71994]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260]
Oct 16 07:31:18 user nova-compute[74080]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05969d64-02be-4924-bf37-7d6cb9366cd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ec6f6-b567-430b-bef5-81901ce76405]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.491s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] <== disconnect_volume: return (2659ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:31:18 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Deleting instance files /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604_del
Oct 16 07:31:18 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Deletion of /opt/stack/data/nova/instances/9ca2ec50-7468-41d7-9bab-5021f4875604_del complete
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully created port: 56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-144d26a5-8a25-4428-90c0-b6b7f0359b56 req-a9f14102-38db-4605-8bb5-4f08e9cf49fe service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received event network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-144d26a5-8a25-4428-90c0-b6b7f0359b56 req-a9f14102-38db-4605-8bb5-4f08e9cf49fe service nova] Acquiring lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-144d26a5-8a25-4428-90c0-b6b7f0359b56 req-a9f14102-38db-4605-8bb5-4f08e9cf49fe service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-144d26a5-8a25-4428-90c0-b6b7f0359b56 req-a9f14102-38db-4605-8bb5-4f08e9cf49fe service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-144d26a5-8a25-4428-90c0-b6b7f0359b56 req-a9f14102-38db-4605-8bb5-4f08e9cf49fe service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] No waiting events found dispatching network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:22 user nova-compute[74080]: WARNING nova.compute.manager [req-144d26a5-8a25-4428-90c0-b6b7f0359b56 req-a9f14102-38db-4605-8bb5-4f08e9cf49fe service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received unexpected event network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 for instance with vm_state building and task_state spawning.
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-ce8dcc7e-e15c-480c-8f21-232a26cf21ac req-8d30a943-0555-4659-908d-05570fcebe62 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received event network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ce8dcc7e-e15c-480c-8f21-232a26cf21ac req-8d30a943-0555-4659-908d-05570fcebe62 service nova] Acquiring lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ce8dcc7e-e15c-480c-8f21-232a26cf21ac req-8d30a943-0555-4659-908d-05570fcebe62 service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ce8dcc7e-e15c-480c-8f21-232a26cf21ac req-8d30a943-0555-4659-908d-05570fcebe62 service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-ce8dcc7e-e15c-480c-8f21-232a26cf21ac req-8d30a943-0555-4659-908d-05570fcebe62 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] No waiting events found dispatching network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:22 user nova-compute[74080]: WARNING nova.compute.manager [req-ce8dcc7e-e15c-480c-8f21-232a26cf21ac req-8d30a943-0555-4659-908d-05570fcebe62 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received unexpected event network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 for instance with vm_state building and task_state spawning.
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74080) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 16 07:31:22 user nova-compute[74080]: INFO nova.virt.libvirt.host [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] UEFI support detected
Oct 16 07:31:22 user nova-compute[74080]: INFO nova.compute.manager [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Took 7.33 seconds to destroy the instance on the hypervisor.
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.objects.instance [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lazy-loading 'flavor' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:22 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:31:22 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7637MB free_disk=25.534954071044922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:22 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Instance spawned successfully.
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] No VIF found with MAC fa:16:3e:61:f7:c8, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:22 user nova-compute[74080]: INFO nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Took 7.82 seconds to spawn the instance on the hypervisor.
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 9ca2ec50-7468-41d7-9bab-5021f4875604 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f055134f-7d13-4ee6-9dfa-11207791a674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 34cb3aed-3c32-460c-adb1-ab9c176be198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1c601514-628d-4f45-9d06-e8eebc943253 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 04e528d5-491a-4914-a1b2-7eee4efc0caf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 01d16a73-705e-4723-b74c-bc2581f1afb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 87991349-e339-4fcf-b4ef-52936a931511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bf301b18-f6ec-49a3-bd42-81d5890f2e28 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.199s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:22 user nova-compute[74080]: INFO nova.compute.manager [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Took 51.81 seconds to build instance.
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8d937faa-fa87-4331-bd3c-4d90056e8d28 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.966s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:22 user nova-compute[74080]: INFO nova.compute.manager [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Attaching volume 2ca08889-064b-4c5b-99bf-069fe6a32805 to /dev/vdb
Oct 16 07:31:22 user nova-compute[74080]: DEBUG os_brick.utils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e5da5f-1ff8-4094-a41c-6b6f0d7068e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be301fa-dad5-43e4-bb18-e3b2cfbfb8d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7ec894-4341-4d28-9df8-7a0f8e4f0219]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c51116-c73b-4245-b4af-fc6c30700119]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:23 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e68462-1326-4248-aba5-22fd5d39f988]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG os_brick.utils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating existing volume attachment record: c2bdaf9c-2dcf-44da-b22c-cafc5e816283 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.763s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:23 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Took 1.16 seconds to deallocate network for instance.
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-7808570e-da7d-4be4-91d6-560f13213dbe req-5c882ebd-339d-4583-b16d-cd7558c72c93 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Received event network-vif-deleted-a39c6a94-feb8-46ca-9b49-195ba8b75d91 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:23 user nova-compute[74080]: INFO nova.compute.manager [req-7808570e-da7d-4be4-91d6-560f13213dbe req-5c882ebd-339d-4583-b16d-cd7558c72c93 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Neutron deleted interface a39c6a94-feb8-46ca-9b49-195ba8b75d91; detaching it from the instance and deleting it from the info cache
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-7808570e-da7d-4be4-91d6-560f13213dbe req-5c882ebd-339d-4583-b16d-cd7558c72c93 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-7808570e-da7d-4be4-91d6-560f13213dbe req-5c882ebd-339d-4583-b16d-cd7558c72c93 service nova] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Detach interface failed, port_id=a39c6a94-feb8-46ca-9b49-195ba8b75d91, reason: Instance 9ca2ec50-7468-41d7-9bab-5021f4875604 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:31:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully created port: 75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:31:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully created port: f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:31:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully created port: 532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:31:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:31:25 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully created port: 37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:31:25 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully updated port: 56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-56cb8287-904e-40a5-96f5-e3fe40bab932. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port 56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a683c2c4-2698-4419-88da-03a483b97a9c req-40867f05-0ae3-452f-b301-8e5476fad8d7 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:27 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully updated port: ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:31:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:27 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully updated port: ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-ebcead91-8bdd-4ee0-9330-eae5e2a70a57. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4e0a4dd4-6961-4492-8209-1377d747778c req-e61b1323-83b8-4352-9465-1e615b7b7496 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:28 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully updated port: 75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:31:29 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully updated port: f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-75ddfca1-10f7-4921-a68e-a9b8a68bebf4. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port 75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully updated port: 532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-f2ece950-a502-4a05-95d2-1a4980191018. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG nova.network.neutron [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-baafbd59-72c0-4184-82c3-eae6606e0513 req-02a8c63f-1ab7-4568-8938-7e8167378767 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:31 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Successfully updated port: 37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:31:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:31 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:31:31 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:31:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-532333ef-8a62-43fb-a297-4fe3b13af87f. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:31:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [{"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance network_info: |[{"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.network.neutron [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port 532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.network.neutron [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updated VIF entry in instance network info cache for port 532333ef-8a62-43fb-a297-4fe3b13af87f. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.network.neutron [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [{"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-37b98f03-614b-4b5c-84b1-ff770ea66ba9. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:33 user nova-compute[74080]: DEBUG nova.network.neutron [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port 37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:31:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updated VIF entry in instance network info cache for port 37b98f03-614b-4b5c-84b1-ff770ea66ba9. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:31:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [{"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f305a29c-13ad-4357-a89d-6d6d0ab49098 req-bb56cc21-1eaa-4bf0-aec9-bc3559859e65 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:37 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f055134f-7d13-4ee6-9dfa-11207791a674 is timed out.
Oct 16 07:31:37 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Successfully detached device vdb from instance f055134f-7d13-4ee6-9dfa-11207791a674 from the live domain config.
Oct 16 07:31:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvoRsBNr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:37 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc351df-f4db-4282-82f3-5213c4bf00a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:31:37 user nova-compute[74080]: No targets found.
Oct 16 07:31:37 user nova-compute[74080]: iSNS:
Oct 16 07:31:37 user nova-compute[74080]: No targets found.
Oct 16 07:31:37 user nova-compute[74080]: STATIC:
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:31:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:37 user nova-compute[74080]: FIRMWARE:
Oct 16 07:31:37 user nova-compute[74080]: No targets found.
Oct 16 07:31:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:31:37 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:31:37 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e5bd2d-20b5-41d0-838c-117b466a36a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09088a7-3915-46b2-8b01-06f96184aa98]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7cc0ef6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb'): ({'sdg'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Removing single pathed devices sdg {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b is timed out.
Oct 16 07:31:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully detached device vdb from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the live domain config.
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQpsRSFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:38 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.214s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2379a-85d5-417f-a1ed-12e2e729c7bc]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe1b6e-a54e-486f-b8f4-bfbae665a64b]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Flushing IO for device /dev/sdg {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ddc18e-09ce-4cbf-b333-5db2bd33405f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b408620a-3d43-4f9d-b663-d128a755a636]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOwDIXGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:38 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae35416-b2de-49cb-843b-aa53b6213200]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c64cd1-deb9-4b29-af23-1ad054f647c4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260]
Oct 16 07:31:38 user nova-compute[74080]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: INFO nova.virt.block_device [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Booting with volume 2faf61ec-a1c7-445c-a7de-aefab2c773a4 at /dev/vdb
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88d2de0f-1b6e-4510-90d1-e4f1094a16bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e5935f-8f43-4216-b3d7-dd5d128d3dc7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.550s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] <== disconnect_volume: return (552ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.259s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[65463302-e831-42ed-b805-1648cfb4ac0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:31:38 user nova-compute[74080]: No targets found.
Oct 16 07:31:38 user nova-compute[74080]: iSNS:
Oct 16 07:31:38 user nova-compute[74080]: No targets found.
Oct 16 07:31:38 user nova-compute[74080]: STATIC:
Oct 16 07:31:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209
Oct 16 07:31:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb
Oct 16 07:31:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:31:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:31:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548
Oct 16 07:31:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:31:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:31:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:38 user nova-compute[74080]: FIRMWARE:
Oct 16 07:31:38 user nova-compute[74080]: No targets found.
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:31:38 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:31:38 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc55ab66-8bcc-4a5a-8f40-4f8c73840e68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[87438ee1-6939-40a0-8d85-f0a0f5e6b873]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 (non-flash)
Oct 16 07:31:38 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7cd381990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548'): ({'sdh'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Removing single pathed devices sdh {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f51090-1cca-4348-82ab-75f79b3c8e2e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[85756af7-823f-4354-a567-b064d01be1ae]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Flushing IO for device /dev/sdh {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[532819aa-4483-4366-92fe-e65eb6557a73]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5c491d-72e1-4740-a6ff-c5c68a07491b]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] SCSI volumes sdh have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] volume_snapshot_create: create_info: {'snapshot_id': '47efb538-b35b-46e0-8cc8-5e57ccef18c7', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74080) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0189a157-70c1-4f0d-8f32-a8dc898a39fc]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] snap xml: <domainsnapshot>
Oct 16 07:31:38 user nova-compute[74080]:   <disks>
Oct 16 07:31:38 user nova-compute[74080]:     <disk name="/dev/sdj" snapshot="external" type="file">
Oct 16 07:31:38 user nova-compute[74080]:       <source file="/dev/new_file"/>
Oct 16 07:31:38 user nova-compute[74080]:     </disk>
Oct 16 07:31:38 user nova-compute[74080]:     <disk name="vda" snapshot="no"/>
Oct 16 07:31:38 user nova-compute[74080]:   </disks>
Oct 16 07:31:38 user nova-compute[74080]: </domainsnapshot>
Oct 16 07:31:38 user nova-compute[74080]:  {{(pid=74080) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.objects.instance [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] Lazy-loading 'system_metadata' on Instance uuid 34cb3aed-3c32-460c-adb1-ab9c176be198 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5b3e3d-5e5c-4788-8fcc-46ad09617be6]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260]
Oct 16 07:31:38 user nova-compute[74080]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f51da70a-656a-42fd-82d2-1b250b8d2b6a tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] volume_snapshot_delete: delete_info: {'volume_id': 'dd715153-3376-4df2-b673-b59584605209'} {{(pid=74080) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [None req-f51da70a-656a-42fd-82d2-1b250b8d2b6a tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Traceback (most recent call last):
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     if delete_info['type'] != 'qcow2':
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] KeyError: 'type'
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] 
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Traceback (most recent call last):
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     rv = execute(f, *args, **kwargs)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     six.reraise(c, e, tb)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     raise value
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     rv = meth(*args, **kwargs)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] 
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Traceback (most recent call last):
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     self._volume_snapshot_create(context, instance, guest,
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     rv = execute(f, *args, **kwargs)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     six.reraise(c, e, tb)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     raise value
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     rv = meth(*args, **kwargs)
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 07:31:38 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] 
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0ae96b0-9b28-42d5-b6f7-f6b9c366f548 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a0d1f-ca6e-4462-848b-4d706cda995e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] <== disconnect_volume: return (642ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.541s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:38 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:38 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: INFO nova.compute.manager [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] [instance: 9ca2ec50-7468-41d7-9bab-5021f4875604] Took 15.24 seconds to detach 1 volumes for instance.
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[61243812-d411-449e-a830-ff9e300a29a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:31:38 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[277c93b4-5ac1-4c7d-b029-cb518cf1e924]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c] added
Oct 16 07:31:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.utils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99bcff4-674f-402d-ac88-023093e3f108]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b512d14-30f8-4d7b-8409-8e4c938b2fa8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb590b-70c5-4a8a-8717-e7e4209d0868]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOwDIXGV {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f93ea88-a3cc-412b-8c20-b29d96f218be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOwDIXGV" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db48733c-d922-4bbd-82b3-ff59f595c476]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cOwDIXGV'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a47a38-0f42-4eca-b92d-78addd8ce7c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc06258-b62c-4e63-b18c-a6d2c35ce917]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1571735f-dab1-4fee-8c9f-025584f8f357]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:39 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e94a94-9f45-4909-8669-0dc5b97e7b04]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.utils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating existing volume attachment record: 264496cf-da70-4f16-a431-151611ce94f4 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [None req-f51da70a-656a-42fd-82d2-1b250b8d2b6a tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-48e77dee-e0af-4666-968f-bec07941accd)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 47efb538-b35b-46e0-8cc8-5e57ccef18c7 could not be found.
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise value
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 47efb538-b35b-46e0-8cc8-5e57ccef18c7 could not be found. (HTTP 404) (Request-ID: req-51b98772-37fd-4977-af45-0a9e86871656)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 47efb538-b35b-46e0-8cc8-5e57ccef18c7 could not be found.
Oct 16 07:31:39 user nova-compute[74080]: ERROR nova.virt.libvirt.driver 
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e25f2f-759e-49c3-8f82-e9f1a25197dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server [None req-f51da70a-656a-42fd-82d2-1b250b8d2b6a tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] Exception during message handling: KeyError: 'type'
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server 
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server [None req-ab8437e3-4f55-4a22-9565-eaa234823582 tempest-VolumesAssistedSnapshotsTest-1233687932 tempest-VolumesAssistedSnapshotsTest-1233687932-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     raise value
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 07:31:39 user nova-compute[74080]: ERROR oslo_messaging.rpc.server 
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebcafd4-9492-4f1c-b31f-1225dc072de1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260]
Oct 16 07:31:39 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f311a28-6405-4b36-88de-7d201b54413e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd281976-dc06-45f2-a21a-89c8011395d0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:39 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec2f255-c036-401f-992c-9a4dcdc51497]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG nova.objects.instance [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lazy-loading 'flavor' on Instance uuid f055134f-7d13-4ee6-9dfa-11207791a674 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d805091d-4b67-4a08-aeb6-b54bb15624de tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.370s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:39 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Deleted allocations for instance 9ca2ec50-7468-41d7-9bab-5021f4875604
Oct 16 07:31:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a3d80344-f8e0-4880-85fd-b5f59bc55237 tempest-DeleteServersTestJSON-1269385163 tempest-DeleteServersTestJSON-1269385163-project-member] Lock "9ca2ec50-7468-41d7-9bab-5021f4875604" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.522s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:39 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'flavor' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e03bba99-dddf-47c2-ad30-46d7361fa999 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.852s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOwDIXGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] <== connect_volume: return (1979ms) {'type': 'block', 'scsi_wwn': '23164333531333735', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164333531333735', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:31:40 user nova-compute[74080]: INFO nova.compute.manager [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Detaching volume dd715153-3376-4df2-b673-b59584605209
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.objects.instance [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lazy-loading 'flavor' on Instance uuid 5e0bc1db-0c8e-400b-814c-da5b19e74b91 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:31:40 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:40 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:31:40 user nova-compute[74080]:   <target dev="sdc" bus="scsi"/>
Oct 16 07:31:40 user nova-compute[74080]:   <serial>28a4ffc9-c174-4b6a-931f-adbb8282f99c</serial>
Oct 16 07:31:40 user nova-compute[74080]:   <address type="drive" controller="0" unit="2"/>
Oct 16 07:31:40 user nova-compute[74080]: </disk>
Oct 16 07:31:40 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:31:40 user nova-compute[74080]: INFO nova.virt.block_device [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Attempting to driver detach volume dd715153-3376-4df2-b673-b59584605209 from mountpoint /dev/vdb
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Attempting to detach device vdb from instance 34cb3aed-3c32-460c-adb1-ab9c176be198 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:40 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:40 user nova-compute[74080]:   <source dev="/dev/sdj"/>
Oct 16 07:31:40 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:40 user nova-compute[74080]:   <serial>dd715153-3376-4df2-b673-b59584605209</serial>
Oct 16 07:31:40 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:31:40 user nova-compute[74080]: </disk>
Oct 16 07:31:40 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Successfully detached device vdb from instance 34cb3aed-3c32-460c-adb1-ab9c176be198 from the persistent domain config.
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34cb3aed-3c32-460c-adb1-ab9c176be198 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:40 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:40 user nova-compute[74080]:   <source dev="/dev/sdj"/>
Oct 16 07:31:40 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:40 user nova-compute[74080]:   <serial>dd715153-3376-4df2-b673-b59584605209</serial>
Oct 16 07:31:40 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:31:40 user nova-compute[74080]: </disk>
Oct 16 07:31:40 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "interface-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-1616715e-9ab5-455f-a830-459d6ea63e83" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "interface-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-1616715e-9ab5-455f-a830-459d6ea63e83" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.objects.instance [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'flavor' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converting VIF {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface> {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface> {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Attempting to detach device tap1616715e-9a from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] detach device xml: <interface type="ethernet">
Oct 16 07:31:40 user nova-compute[74080]:   <mac address="fa:16:3e:fd:52:14"/>
Oct 16 07:31:40 user nova-compute[74080]:   <model type="virtio"/>
Oct 16 07:31:40 user nova-compute[74080]:   <mtu size="1442"/>
Oct 16 07:31:40 user nova-compute[74080]:   <target dev="tap1616715e-9a"/>
Oct 16 07:31:40 user nova-compute[74080]: </interface>
Oct 16 07:31:40 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface> {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 16 07:31:40 user nova-compute[74080]:   <name>instance-00000005</name>
Oct 16 07:31:40 user nova-compute[74080]:   <uuid>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</uuid>
Oct 16 07:31:40 user nova-compute[74080]:   <metadata>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:31:40 user nova-compute[74080]:   <nova:package version="0.0.0"/>
Oct 16 07:31:40 user nova-compute[74080]:   <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:31:40 user nova-compute[74080]:   <nova:creationTime>2023-10-16 07:30:41</nova:creationTime>
Oct 16 07:31:40 user nova-compute[74080]:   <nova:flavor name="m1.tiny">
Oct 16 07:31:40 user nova-compute[74080]:     <nova:memory>512</nova:memory>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:disk>1</nova:disk>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:swap>0</nova:swap>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:vcpus>1</nova:vcpus>
Oct 16 07:31:40 user nova-compute[74080]:   </nova:flavor>
Oct 16 07:31:40 user nova-compute[74080]:   <nova:owner>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:31:40 user nova-compute[74080]:   </nova:owner>
Oct 16 07:31:40 user nova-compute[74080]:   <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:31:40 user nova-compute[74080]:   <nova:ports>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:31:40 user nova-compute[74080]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:31:40 user nova-compute[74080]:     </nova:port>
Oct 16 07:31:40 user nova-compute[74080]:     <nova:port uuid="1616715e-9ab5-455f-a830-459d6ea63e83">
Oct 16 07:31:40 user nova-compute[74080]:       <nova:ip type="fixed" address="10.10.10.113" ipVersion="4"/>
Oct 16 07:31:40 user nova-compute[74080]:     </nova:port>
Oct 16 07:31:40 user nova-compute[74080]:   </nova:ports>
Oct 16 07:31:40 user nova-compute[74080]: </nova:instance>
Oct 16 07:31:40 user nova-compute[74080]:   </metadata>
Oct 16 07:31:40 user nova-compute[74080]:   <memory unit='KiB'>524288</memory>
Oct 16 07:31:40 user nova-compute[74080]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 07:31:40 user nova-compute[74080]:   <vcpu placement='static'>1</vcpu>
Oct 16 07:31:40 user nova-compute[74080]:   <resource>
Oct 16 07:31:40 user nova-compute[74080]:     <partition>/machine</partition>
Oct 16 07:31:40 user nova-compute[74080]:   </resource>
Oct 16 07:31:40 user nova-compute[74080]:   <sysinfo type='smbios'>
Oct 16 07:31:40 user nova-compute[74080]:     <system>
Oct 16 07:31:40 user nova-compute[74080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 07:31:40 user nova-compute[74080]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 07:31:40 user nova-compute[74080]:       <entry name='version'>0.0.0</entry>
Oct 16 07:31:40 user nova-compute[74080]:       <entry name='serial'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:31:40 user nova-compute[74080]:       <entry name='uuid'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:31:40 user nova-compute[74080]:       <entry name='family'>Virtual Machine</entry>
Oct 16 07:31:40 user nova-compute[74080]:     </system>
Oct 16 07:31:40 user nova-compute[74080]:   </sysinfo>
Oct 16 07:31:40 user nova-compute[74080]:   <os>
Oct 16 07:31:40 user nova-compute[74080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 07:31:40 user nova-compute[74080]:     <boot dev='hd'/>
Oct 16 07:31:40 user nova-compute[74080]:     <smbios mode='sysinfo'/>
Oct 16 07:31:40 user nova-compute[74080]:   </os>
Oct 16 07:31:40 user nova-compute[74080]:   <features>
Oct 16 07:31:40 user nova-compute[74080]:     <acpi/>
Oct 16 07:31:40 user nova-compute[74080]:     <apic/>
Oct 16 07:31:40 user nova-compute[74080]:     <vmcoreinfo state='on'/>
Oct 16 07:31:40 user nova-compute[74080]:   </features>
Oct 16 07:31:40 user nova-compute[74080]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 07:31:40 user nova-compute[74080]:     <model fallback='forbid'>Nehalem</model>
Oct 16 07:31:40 user nova-compute[74080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 07:31:40 user nova-compute[74080]:     <feature policy='require' name='vme'/>
Oct 16 07:31:40 user nova-compute[74080]:     <feature policy='require' name='x2apic'/>
Oct 16 07:31:40 user nova-compute[74080]:     <feature policy='require' name='hypervisor'/>
Oct 16 07:31:40 user nova-compute[74080]:   </cpu>
Oct 16 07:31:40 user nova-compute[74080]:   <clock offset='utc'>
Oct 16 07:31:40 user nova-compute[74080]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 07:31:40 user nova-compute[74080]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 07:31:40 user nova-compute[74080]:     <timer name='hpet' present='no'/>
Oct 16 07:31:40 user nova-compute[74080]:   </clock>
Oct 16 07:31:40 user nova-compute[74080]:   <on_poweroff>destroy</on_poweroff>
Oct 16 07:31:40 user nova-compute[74080]:   <on_reboot>restart</on_reboot>
Oct 16 07:31:40 user nova-compute[74080]:   <on_crash>destroy</on_crash>
Oct 16 07:31:40 user nova-compute[74080]:   <devices>
Oct 16 07:31:40 user nova-compute[74080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 07:31:40 user nova-compute[74080]:     <disk type='file' device='disk'>
Oct 16 07:31:40 user nova-compute[74080]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 07:31:40 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk' index='2'/>
Oct 16 07:31:40 user nova-compute[74080]:       <backingStore type='file' index='3'>
Oct 16 07:31:40 user nova-compute[74080]:         <format type='raw'/>
Oct 16 07:31:40 user nova-compute[74080]:         <source file='/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca'/>
Oct 16 07:31:40 user nova-compute[74080]:         <backingStore/>
Oct 16 07:31:40 user nova-compute[74080]:       </backingStore>
Oct 16 07:31:40 user nova-compute[74080]:       <target dev='vda' bus='virtio'/>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='virtio-disk0'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </disk>
Oct 16 07:31:40 user nova-compute[74080]:     <disk type='file' device='cdrom'>
Oct 16 07:31:40 user nova-compute[74080]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 07:31:40 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config' index='1'/>
Oct 16 07:31:40 user nova-compute[74080]:       <backingStore/>
Oct 16 07:31:40 user nova-compute[74080]:       <target dev='hda' bus='ide'/>
Oct 16 07:31:40 user nova-compute[74080]:       <readonly/>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='ide0-0-0'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </disk>
Oct 16 07:31:40 user nova-compute[74080]:     <controller type='usb' index='0' model='none'>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='usb'/>
Oct 16 07:31:40 user nova-compute[74080]:     </controller>
Oct 16 07:31:40 user nova-compute[74080]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='pci.0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </controller>
Oct 16 07:31:40 user nova-compute[74080]:     <controller type='ide' index='0'>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='ide'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 07:31:40 user nova-compute[74080]:     </controller>
Oct 16 07:31:40 user nova-compute[74080]:     <interface type='ethernet'>
Oct 16 07:31:40 user nova-compute[74080]:       <mac address='fa:16:3e:2f:6f:2b'/>
Oct 16 07:31:40 user nova-compute[74080]:       <target dev='tap7d924de9-0e'/>
Oct 16 07:31:40 user nova-compute[74080]:       <model type='virtio'/>
Oct 16 07:31:40 user nova-compute[74080]:       <mtu size='1442'/>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='net0'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </interface>
Oct 16 07:31:40 user nova-compute[74080]:     <interface type='ethernet'>
Oct 16 07:31:40 user nova-compute[74080]:       <mac address='fa:16:3e:fd:52:14'/>
Oct 16 07:31:40 user nova-compute[74080]:       <target dev='tap1616715e-9a'/>
Oct 16 07:31:40 user nova-compute[74080]:       <model type='virtio'/>
Oct 16 07:31:40 user nova-compute[74080]:       <mtu size='1442'/>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='net1'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </interface>
Oct 16 07:31:40 user nova-compute[74080]:     <serial type='pty'>
Oct 16 07:31:40 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:31:40 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:31:40 user nova-compute[74080]:       <target type='isa-serial' port='0'>
Oct 16 07:31:40 user nova-compute[74080]:         <model name='isa-serial'/>
Oct 16 07:31:40 user nova-compute[74080]:       </target>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </serial>
Oct 16 07:31:40 user nova-compute[74080]:     <console type='pty' tty='/dev/pts/4'>
Oct 16 07:31:40 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:31:40 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:31:40 user nova-compute[74080]:       <target type='serial' port='0'/>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </console>
Oct 16 07:31:40 user nova-compute[74080]:     <input type='mouse' bus='ps2'>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='input0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </input>
Oct 16 07:31:40 user nova-compute[74080]:     <input type='keyboard' bus='ps2'>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='input1'/>
Oct 16 07:31:40 user nova-compute[74080]:     </input>
Oct 16 07:31:40 user nova-compute[74080]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 16 07:31:40 user nova-compute[74080]:       <listen type='address' address='0.0.0.0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </graphics>
Oct 16 07:31:40 user nova-compute[74080]:     <audio id='1' type='none'/>
Oct 16 07:31:40 user nova-compute[74080]:     <video>
Oct 16 07:31:40 user nova-compute[74080]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='video0'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </video>
Oct 16 07:31:40 user nova-compute[74080]:     <memballoon model='virtio'>
Oct 16 07:31:40 user nova-compute[74080]:       <stats period='10'/>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='balloon0'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </memballoon>
Oct 16 07:31:40 user nova-compute[74080]:     <rng model='virtio'>
Oct 16 07:31:40 user nova-compute[74080]:       <backend model='random'>/dev/urandom</backend>
Oct 16 07:31:40 user nova-compute[74080]:       <alias name='rng0'/>
Oct 16 07:31:40 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 07:31:40 user nova-compute[74080]:     </rng>
Oct 16 07:31:40 user nova-compute[74080]:   </devices>
Oct 16 07:31:40 user nova-compute[74080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 07:31:40 user nova-compute[74080]:     <label>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</label>
Oct 16 07:31:40 user nova-compute[74080]:     <imagelabel>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</imagelabel>
Oct 16 07:31:40 user nova-compute[74080]:   </seclabel>
Oct 16 07:31:40 user nova-compute[74080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 07:31:40 user nova-compute[74080]:     <label>+64055:+108</label>
Oct 16 07:31:40 user nova-compute[74080]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 07:31:40 user nova-compute[74080]:   </seclabel>
Oct 16 07:31:40 user nova-compute[74080]: </domain>
Oct 16 07:31:40 user nova-compute[74080]:  {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 07:31:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully detached device tap1616715e-9a from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the persistent domain config.
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] (1/8): Attempting to detach device tap1616715e-9a with device alias net1 from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:31:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] detach device xml: <interface type="ethernet">
Oct 16 07:31:40 user nova-compute[74080]:   <mac address="fa:16:3e:fd:52:14"/>
Oct 16 07:31:40 user nova-compute[74080]:   <model type="virtio"/>
Oct 16 07:31:40 user nova-compute[74080]:   <mtu size="1442"/>
Oct 16 07:31:40 user nova-compute[74080]:   <target dev="tap1616715e-9a"/>
Oct 16 07:31:40 user nova-compute[74080]: </interface>
Oct 16 07:31:40 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] No BDM found with device name sda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] No VIF found with MAC fa:16:3e:43:27:34, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34cb3aed-3c32-460c-adb1-ab9c176be198 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Start waiting for the detach event from libvirt for device tap1616715e-9a with device alias net1 for instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cb67f0b0-a06f-41f3-b550-e631699c50d3 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 47.555s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-45ae7b51-34e8-4650-a458-b7cff68a1291 req-fbf5a9e1-7e2b-45b5-ac50-d182d0169f65 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-unplugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-45ae7b51-34e8-4650-a458-b7cff68a1291 req-fbf5a9e1-7e2b-45b5-ac50-d182d0169f65 service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-45ae7b51-34e8-4650-a458-b7cff68a1291 req-fbf5a9e1-7e2b-45b5-ac50-d182d0169f65 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-45ae7b51-34e8-4650-a458-b7cff68a1291 req-fbf5a9e1-7e2b-45b5-ac50-d182d0169f65 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-45ae7b51-34e8-4650-a458-b7cff68a1291 req-fbf5a9e1-7e2b-45b5-ac50-d182d0169f65 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-unplugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:41 user nova-compute[74080]: WARNING nova.compute.manager [req-45ae7b51-34e8-4650-a458-b7cff68a1291 req-fbf5a9e1-7e2b-45b5-ac50-d182d0169f65 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received unexpected event network-vif-unplugged-1616715e-9ab5-455f-a830-459d6ea63e83 for instance with vm_state active and task_state None.
Oct 16 07:31:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:41 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:41 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:41 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb8b27-4075-4d77-9da4-96f986f046c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:31:41 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a8743c-fc89-4546-b2b4-6bc03290230e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805] added
Oct 16 07:31:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc3b59-1e68-4fb9-b7b6-2e1935e376f7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efb3d27-f7ba-4997-a17a-95b07d95a380]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAKLEMOy {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAKLEMOy" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b74bb3-4bdf-41d4-b848-b8cfdf22c05a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JAKLEMOy'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[97748a60-5483-475d-aeaa-520c3b316542]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd586745-b3c1-4823-8822-cf11f4407310]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[545321e0-8bfb-4bf4-b256-f050e19854fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]
Oct 16 07:31:41 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d92ba9-5619-4701-af1a-9db5fea54ab9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa457120-a5c4-4e47-8948-12bf0021b4c5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:41 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0035a9-c618-4fae-99fd-352fe23ef0bd]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:31:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:42 user nova-compute[74080]: INFO nova.compute.manager [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Detaching volume 28a4ffc9-c174-4b6a-931f-adbb8282f99c
Oct 16 07:31:42 user nova-compute[74080]: INFO nova.virt.block_device [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Attempting to driver detach volume 28a4ffc9-c174-4b6a-931f-adbb8282f99c from mountpoint /dev/sdc
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Attempting to detach device sdc from instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:42 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:42 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:31:42 user nova-compute[74080]:   <target dev="sdc" bus="scsi"/>
Oct 16 07:31:42 user nova-compute[74080]:   <serial>28a4ffc9-c174-4b6a-931f-adbb8282f99c</serial>
Oct 16 07:31:42 user nova-compute[74080]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 07:31:42 user nova-compute[74080]: </disk>
Oct 16 07:31:42 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:42 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Successfully detached device sdc from instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 from the persistent domain config.
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:31:42 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:42 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:31:42 user nova-compute[74080]:   <target dev="sdc" bus="scsi"/>
Oct 16 07:31:42 user nova-compute[74080]:   <serial>28a4ffc9-c174-4b6a-931f-adbb8282f99c</serial>
Oct 16 07:31:42 user nova-compute[74080]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 07:31:42 user nova-compute[74080]: </disk>
Oct 16 07:31:42 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26632656334613731', 'path': '/dev/sdg'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632656334613731', 'path': '/dev/sdg'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.objects.instance [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lazy-loading 'flavor' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:31:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:31:42 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:31:42 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:31:42 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:31:42 user nova-compute[74080]:   <serial>2ca08889-064b-4c5b-99bf-069fe6a32805</serial>
Oct 16 07:31:42 user nova-compute[74080]: </disk>
Oct 16 07:31:42 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No VIF found with MAC fa:16:3e:29:3d:72, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-ec900a31-70ca-4f56-9f33-14bbf41e1c28 req-8d98f690-ca4f-4eac-9598-05835415c9c4 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ec900a31-70ca-4f56-9f33-14bbf41e1c28 req-8d98f690-ca4f-4eac-9598-05835415c9c4 service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ec900a31-70ca-4f56-9f33-14bbf41e1c28 req-8d98f690-ca4f-4eac-9598-05835415c9c4 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ec900a31-70ca-4f56-9f33-14bbf41e1c28 req-8d98f690-ca4f-4eac-9598-05835415c9c4 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-ec900a31-70ca-4f56-9f33-14bbf41e1c28 req-8d98f690-ca4f-4eac-9598-05835415c9c4 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:43 user nova-compute[74080]: WARNING nova.compute.manager [req-ec900a31-70ca-4f56-9f33-14bbf41e1c28 req-8d98f690-ca4f-4eac-9598-05835415c9c4 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received unexpected event network-vif-plugged-1616715e-9ab5-455f-a830-459d6ea63e83 for instance with vm_state active and task_state None.
Oct 16 07:31:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-eb11ec27-a2ac-4939-9876-68ad6ef36e2e tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.803s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Stashing vm_state: active {{(pid=74080) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:31:46 user nova-compute[74080]: INFO nova.compute.claims [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Claim successful on node user
Oct 16 07:31:46 user nova-compute[74080]: INFO nova.compute.resource_tracker [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating resource usage from migration 885bd991-2f2e-433a-ba8d-461991be5fed
Oct 16 07:31:46 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.558s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:46 user nova-compute[74080]: INFO nova.compute.manager [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Migrating
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:46 user nova-compute[74080]: INFO nova.compute.rpcapi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Starting migrate_disk_and_power_off {{(pid=74080) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-3b00f311-19ee-46ad-bd46-7c7b0540768a req-2aa18a92-1f86-41d9-ad97-607c7c1ed46f service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3b00f311-19ee-46ad-bd46-7c7b0540768a req-2aa18a92-1f86-41d9-ad97-607c7c1ed46f service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3b00f311-19ee-46ad-bd46-7c7b0540768a req-2aa18a92-1f86-41d9-ad97-607c7c1ed46f service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3b00f311-19ee-46ad-bd46-7c7b0540768a req-2aa18a92-1f86-41d9-ad97-607c7c1ed46f service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-3b00f311-19ee-46ad-bd46-7c7b0540768a req-2aa18a92-1f86-41d9-ad97-607c7c1ed46f service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:47 user nova-compute[74080]: WARNING nova.compute.manager [req-3b00f311-19ee-46ad-bd46-7c7b0540768a req-2aa18a92-1f86-41d9-ad97-607c7c1ed46f service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state active and task_state resize_migrating.
Oct 16 07:31:48 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance destroyed successfully.
Oct 16 07:31:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-747411497-network", "vif_mac": "fa:16:3e:29:3d:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-747411497-network", "vif_mac": "fa:16:3e:29:3d:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_vif [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1184cb83-61, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b22287b-6175-4dab-a158-1c76b28c9091) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:48 user nova-compute[74080]: INFO os_vif [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61')
Oct 16 07:31:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:48 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd874910-17ee-43a6-b898-75301d06fbe9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:31:48 user nova-compute[74080]: No targets found.
Oct 16 07:31:48 user nova-compute[74080]: iSNS:
Oct 16 07:31:48 user nova-compute[74080]: No targets found.
Oct 16 07:31:48 user nova-compute[74080]: STATIC:
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:31:48 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:31:48 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:31:48 user nova-compute[74080]: FIRMWARE:
Oct 16 07:31:48 user nova-compute[74080]: No targets found.
Oct 16 07:31:48 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:31:48 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:31:48 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e9bc24-3f74-461e-8577-1cb0cc70e5bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da74d7-036a-4493-9f2c-29a3ad2505c1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:48 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:31:48 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:31:48 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac424c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805'): ({'sdg'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Removing single pathed devices sdg {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b746792-eb74-40f3-8f57-8b360310347e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dffe31-753b-4946-a4c8-6bd19e471984]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flushing IO for device /dev/sdg {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.011s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c5537-e908-4c19-8bfe-46ce3a5f76b1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c45d2b-479a-4ee5-8956-cd990bde157b]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6a414-5fd1-47d5-b510-e2c0d55958a6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02764c5-7593-43f5-860e-6b789636e88f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]
Oct 16 07:31:48 user nova-compute[74080]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.
Oct 16 07:31:48 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2130faee-71b0-4b69-aae9-ff9c4d23c922]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== disconnect_volume: return (359ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:31:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723_resize/disk /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "cp -r /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723_resize/disk /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk" returned: 0 in 0.331s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723_resize/disk.info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk.info {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "cp -r /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723_resize/disk.info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk.info" returned: 0 in 0.030s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-f741afee-5460-4005-a19f-f18efb62d3d4 req-11683ea1-3ba2-4633-ba2d-84eee4d499b6 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f741afee-5460-4005-a19f-f18efb62d3d4 req-11683ea1-3ba2-4633-ba2d-84eee4d499b6 service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f741afee-5460-4005-a19f-f18efb62d3d4 req-11683ea1-3ba2-4633-ba2d-84eee4d499b6 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f741afee-5460-4005-a19f-f18efb62d3d4 req-11683ea1-3ba2-4633-ba2d-84eee4d499b6 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-f741afee-5460-4005-a19f-f18efb62d3d4 req-11683ea1-3ba2-4633-ba2d-84eee4d499b6 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:31:49 user nova-compute[74080]: WARNING nova.compute.manager [req-f741afee-5460-4005-a19f-f18efb62d3d4 req-11683ea1-3ba2-4633-ba2d-84eee4d499b6 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state active and task_state resize_migrating.
Oct 16 07:31:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Port 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 binding to destination host user is already ACTIVE {{(pid=74080) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:31:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG os_brick.utils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d9998a-4de2-4370-b931-bda546dd4d9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf690c-19d2-451a-86a8-1618260e2fcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cc1313-6498-43a5-af7c-5843cfb5250b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[606a09cc-72bb-4add-98b4-d465a615919a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:31:51 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:31:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ebcb91-2fff-46b4-8306-f02d28b5c738]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:31:51 user nova-compute[74080]: DEBUG os_brick.utils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:31:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:31:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:01 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34cb3aed-3c32-460c-adb1-ab9c176be198 is timed out.
Oct 16 07:32:01 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Successfully detached device vdb from instance 34cb3aed-3c32-460c-adb1-ab9c176be198 from the live domain config.
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOZiGAXJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:32:01 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Waiting for libvirt event about the detach of device tap1616715e-9a with device alias net1 from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b is timed out.
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface> {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 16 07:32:01 user nova-compute[74080]:   <name>instance-00000005</name>
Oct 16 07:32:01 user nova-compute[74080]:   <uuid>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</uuid>
Oct 16 07:32:01 user nova-compute[74080]:   <metadata>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:32:01 user nova-compute[74080]:   <nova:package version="0.0.0"/>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:creationTime>2023-10-16 07:30:41</nova:creationTime>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:flavor name="m1.tiny">
Oct 16 07:32:01 user nova-compute[74080]:     <nova:memory>512</nova:memory>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:disk>1</nova:disk>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:swap>0</nova:swap>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:vcpus>1</nova:vcpus>
Oct 16 07:32:01 user nova-compute[74080]:   </nova:flavor>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:owner>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:32:01 user nova-compute[74080]:   </nova:owner>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:ports>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:32:01 user nova-compute[74080]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:32:01 user nova-compute[74080]:     </nova:port>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:port uuid="1616715e-9ab5-455f-a830-459d6ea63e83">
Oct 16 07:32:01 user nova-compute[74080]:       <nova:ip type="fixed" address="10.10.10.113" ipVersion="4"/>
Oct 16 07:32:01 user nova-compute[74080]:     </nova:port>
Oct 16 07:32:01 user nova-compute[74080]:   </nova:ports>
Oct 16 07:32:01 user nova-compute[74080]: </nova:instance>
Oct 16 07:32:01 user nova-compute[74080]:   </metadata>
Oct 16 07:32:01 user nova-compute[74080]:   <memory unit='KiB'>524288</memory>
Oct 16 07:32:01 user nova-compute[74080]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 07:32:01 user nova-compute[74080]:   <vcpu placement='static'>1</vcpu>
Oct 16 07:32:01 user nova-compute[74080]:   <resource>
Oct 16 07:32:01 user nova-compute[74080]:     <partition>/machine</partition>
Oct 16 07:32:01 user nova-compute[74080]:   </resource>
Oct 16 07:32:01 user nova-compute[74080]:   <sysinfo type='smbios'>
Oct 16 07:32:01 user nova-compute[74080]:     <system>
Oct 16 07:32:01 user nova-compute[74080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 07:32:01 user nova-compute[74080]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 07:32:01 user nova-compute[74080]:       <entry name='version'>0.0.0</entry>
Oct 16 07:32:01 user nova-compute[74080]:       <entry name='serial'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:32:01 user nova-compute[74080]:       <entry name='uuid'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:32:01 user nova-compute[74080]:       <entry name='family'>Virtual Machine</entry>
Oct 16 07:32:01 user nova-compute[74080]:     </system>
Oct 16 07:32:01 user nova-compute[74080]:   </sysinfo>
Oct 16 07:32:01 user nova-compute[74080]:   <os>
Oct 16 07:32:01 user nova-compute[74080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 07:32:01 user nova-compute[74080]:     <boot dev='hd'/>
Oct 16 07:32:01 user nova-compute[74080]:     <smbios mode='sysinfo'/>
Oct 16 07:32:01 user nova-compute[74080]:   </os>
Oct 16 07:32:01 user nova-compute[74080]:   <features>
Oct 16 07:32:01 user nova-compute[74080]:     <acpi/>
Oct 16 07:32:01 user nova-compute[74080]:     <apic/>
Oct 16 07:32:01 user nova-compute[74080]:     <vmcoreinfo state='on'/>
Oct 16 07:32:01 user nova-compute[74080]:   </features>
Oct 16 07:32:01 user nova-compute[74080]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 07:32:01 user nova-compute[74080]:     <model fallback='forbid'>Nehalem</model>
Oct 16 07:32:01 user nova-compute[74080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 07:32:01 user nova-compute[74080]:     <feature policy='require' name='vme'/>
Oct 16 07:32:01 user nova-compute[74080]:     <feature policy='require' name='x2apic'/>
Oct 16 07:32:01 user nova-compute[74080]:     <feature policy='require' name='hypervisor'/>
Oct 16 07:32:01 user nova-compute[74080]:   </cpu>
Oct 16 07:32:01 user nova-compute[74080]:   <clock offset='utc'>
Oct 16 07:32:01 user nova-compute[74080]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 07:32:01 user nova-compute[74080]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 07:32:01 user nova-compute[74080]:     <timer name='hpet' present='no'/>
Oct 16 07:32:01 user nova-compute[74080]:   </clock>
Oct 16 07:32:01 user nova-compute[74080]:   <on_poweroff>destroy</on_poweroff>
Oct 16 07:32:01 user nova-compute[74080]:   <on_reboot>restart</on_reboot>
Oct 16 07:32:01 user nova-compute[74080]:   <on_crash>destroy</on_crash>
Oct 16 07:32:01 user nova-compute[74080]:   <devices>
Oct 16 07:32:01 user nova-compute[74080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 07:32:01 user nova-compute[74080]:     <disk type='file' device='disk'>
Oct 16 07:32:01 user nova-compute[74080]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 07:32:01 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk' index='2'/>
Oct 16 07:32:01 user nova-compute[74080]:       <backingStore type='file' index='3'>
Oct 16 07:32:01 user nova-compute[74080]:         <format type='raw'/>
Oct 16 07:32:01 user nova-compute[74080]:         <source file='/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca'/>
Oct 16 07:32:01 user nova-compute[74080]:         <backingStore/>
Oct 16 07:32:01 user nova-compute[74080]:       </backingStore>
Oct 16 07:32:01 user nova-compute[74080]:       <target dev='vda' bus='virtio'/>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='virtio-disk0'/>
Oct 16 07:32:01 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </disk>
Oct 16 07:32:01 user nova-compute[74080]:     <disk type='file' device='cdrom'>
Oct 16 07:32:01 user nova-compute[74080]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 07:32:01 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config' index='1'/>
Oct 16 07:32:01 user nova-compute[74080]:       <backingStore/>
Oct 16 07:32:01 user nova-compute[74080]:       <target dev='hda' bus='ide'/>
Oct 16 07:32:01 user nova-compute[74080]:       <readonly/>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='ide0-0-0'/>
Oct 16 07:32:01 user nova-compute[74080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </disk>
Oct 16 07:32:01 user nova-compute[74080]:     <controller type='usb' index='0' model='none'>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='usb'/>
Oct 16 07:32:01 user nova-compute[74080]:     </controller>
Oct 16 07:32:01 user nova-compute[74080]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='pci.0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </controller>
Oct 16 07:32:01 user nova-compute[74080]:     <controller type='ide' index='0'>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='ide'/>
Oct 16 07:32:01 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 07:32:01 user nova-compute[74080]:     </controller>
Oct 16 07:32:01 user nova-compute[74080]:     <interface type='ethernet'>
Oct 16 07:32:01 user nova-compute[74080]:       <mac address='fa:16:3e:2f:6f:2b'/>
Oct 16 07:32:01 user nova-compute[74080]:       <target dev='tap7d924de9-0e'/>
Oct 16 07:32:01 user nova-compute[74080]:       <model type='virtio'/>
Oct 16 07:32:01 user nova-compute[74080]:       <mtu size='1442'/>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='net0'/>
Oct 16 07:32:01 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </interface>
Oct 16 07:32:01 user nova-compute[74080]:     <serial type='pty'>
Oct 16 07:32:01 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:32:01 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:32:01 user nova-compute[74080]:       <target type='isa-serial' port='0'>
Oct 16 07:32:01 user nova-compute[74080]:         <model name='isa-serial'/>
Oct 16 07:32:01 user nova-compute[74080]:       </target>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </serial>
Oct 16 07:32:01 user nova-compute[74080]:     <console type='pty' tty='/dev/pts/4'>
Oct 16 07:32:01 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:32:01 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:32:01 user nova-compute[74080]:       <target type='serial' port='0'/>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </console>
Oct 16 07:32:01 user nova-compute[74080]:     <input type='mouse' bus='ps2'>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='input0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </input>
Oct 16 07:32:01 user nova-compute[74080]:     <input type='keyboard' bus='ps2'>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='input1'/>
Oct 16 07:32:01 user nova-compute[74080]:     </input>
Oct 16 07:32:01 user nova-compute[74080]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 16 07:32:01 user nova-compute[74080]:       <listen type='address' address='0.0.0.0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </graphics>
Oct 16 07:32:01 user nova-compute[74080]:     <audio id='1' type='none'/>
Oct 16 07:32:01 user nova-compute[74080]:     <video>
Oct 16 07:32:01 user nova-compute[74080]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='video0'/>
Oct 16 07:32:01 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </video>
Oct 16 07:32:01 user nova-compute[74080]:     <memballoon model='virtio'>
Oct 16 07:32:01 user nova-compute[74080]:       <stats period='10'/>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='balloon0'/>
Oct 16 07:32:01 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </memballoon>
Oct 16 07:32:01 user nova-compute[74080]:     <rng model='virtio'>
Oct 16 07:32:01 user nova-compute[74080]:       <backend model='random'>/dev/urandom</backend>
Oct 16 07:32:01 user nova-compute[74080]:       <alias name='rng0'/>
Oct 16 07:32:01 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 07:32:01 user nova-compute[74080]:     </rng>
Oct 16 07:32:01 user nova-compute[74080]:   </devices>
Oct 16 07:32:01 user nova-compute[74080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 07:32:01 user nova-compute[74080]:     <label>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</label>
Oct 16 07:32:01 user nova-compute[74080]:     <imagelabel>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</imagelabel>
Oct 16 07:32:01 user nova-compute[74080]:   </seclabel>
Oct 16 07:32:01 user nova-compute[74080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 07:32:01 user nova-compute[74080]:     <label>+64055:+108</label>
Oct 16 07:32:01 user nova-compute[74080]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 07:32:01 user nova-compute[74080]:   </seclabel>
Oct 16 07:32:01 user nova-compute[74080]: </domain>
Oct 16 07:32:01 user nova-compute[74080]:  {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 07:32:01 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully detached device tap1616715e-9a from instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b from the live domain config.
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converting VIF {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_vif [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[204a2186-395c-4198-a954-5508e78a5683]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:32:01 user nova-compute[74080]: No targets found.
Oct 16 07:32:01 user nova-compute[74080]: iSNS:
Oct 16 07:32:01 user nova-compute[74080]: No targets found.
Oct 16 07:32:01 user nova-compute[74080]: STATIC:
Oct 16 07:32:01 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c
Oct 16 07:32:01 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:01 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:01 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209
Oct 16 07:32:01 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:01 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:01 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb
Oct 16 07:32:01 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:01 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:01 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:32:01 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:01 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:01 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:32:01 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:01 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:01 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:32:01 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:01 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:01 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:32:01 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:01 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:01 user nova-compute[74080]: FIRMWARE:
Oct 16 07:32:01 user nova-compute[74080]: No targets found.
Oct 16 07:32:01 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:32:01 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:32:01 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1616715e-9a, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7cb6602-8546-4006-87b0-4023d8ded635) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:01 user nova-compute[74080]: INFO os_vif [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a')
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:32:01 user nova-compute[74080]:   <nova:package version="0.0.0"/>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:creationTime>2023-10-16 07:32:01</nova:creationTime>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:flavor name="m1.tiny">
Oct 16 07:32:01 user nova-compute[74080]:     <nova:memory>512</nova:memory>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:disk>1</nova:disk>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:swap>0</nova:swap>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:vcpus>1</nova:vcpus>
Oct 16 07:32:01 user nova-compute[74080]:   </nova:flavor>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:owner>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:32:01 user nova-compute[74080]:   </nova:owner>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:32:01 user nova-compute[74080]:   <nova:ports>
Oct 16 07:32:01 user nova-compute[74080]:     <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:32:01 user nova-compute[74080]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:32:01 user nova-compute[74080]:     </nova:port>
Oct 16 07:32:01 user nova-compute[74080]:   </nova:ports>
Oct 16 07:32:01 user nova-compute[74080]: </nova:instance>
Oct 16 07:32:01 user nova-compute[74080]:  {{(pid=74080) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb208aa-8d1c-40e7-aad6-61d7ba274e6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[639d90c8-955a-4549-a149-cccbf628feea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:01 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:01 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:01 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac41fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209'): ({'sdj'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Removing single pathed devices sdj {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[147c1500-82d2-456b-88c0-123b8cf731df]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[960aaa7e-4e38-4880-bff2-2234f5a4e68f]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Flushing IO for device /dev/sdj {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b4c4c6-f86a-433b-83cd-e1a036cd2c77]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43de45c-5d7d-4ab1-b8eb-077c74c476de]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] SCSI volumes sdj have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef1d36-18d2-4776-bd0a-0f2effd46915]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef086b1-c324-4b8d-8c61-cd890d702578]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260]
Oct 16 07:32:01 user nova-compute[74080]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209, portal: 172.16.0.220,3260] successful.
Oct 16 07:32:01 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd715153-3376-4df2-b673-b59584605209 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c12e8b9-4332-4091-ad3e-42489bb5993f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] <== disconnect_volume: return (404ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:32:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.compute.manager [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-deleted-1616715e-9ab5-455f-a830-459d6ea63e83 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:02 user nova-compute[74080]: INFO nova.compute.manager [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Neutron deleted interface 1616715e-9ab5-455f-a830-459d6ea63e83; detaching it from the instance and deleting it from the info cache
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquired lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.network.neutron [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.objects.instance [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Lazy-loading 'system_metadata' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.objects.instance [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Lazy-loading 'flavor' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.objects.base [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Object Instance<3dc7ff51-67ae-4d38-bf1f-e28483e40d5b> lazy-loaded attributes: system_metadata,flavor {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.network.os_vif_util [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Converting VIF {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.network.os_vif_util [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface> {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 16 07:32:02 user nova-compute[74080]:   <name>instance-00000005</name>
Oct 16 07:32:02 user nova-compute[74080]:   <uuid>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</uuid>
Oct 16 07:32:02 user nova-compute[74080]:   <metadata>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:32:02 user nova-compute[74080]:   <nova:package version="0.0.0"/>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:creationTime>2023-10-16 07:32:01</nova:creationTime>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:flavor name="m1.tiny">
Oct 16 07:32:02 user nova-compute[74080]:     <nova:memory>512</nova:memory>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:disk>1</nova:disk>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:swap>0</nova:swap>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:vcpus>1</nova:vcpus>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:flavor>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:owner>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:owner>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:ports>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:32:02 user nova-compute[74080]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:32:02 user nova-compute[74080]:     </nova:port>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:ports>
Oct 16 07:32:02 user nova-compute[74080]: </nova:instance>
Oct 16 07:32:02 user nova-compute[74080]:   </metadata>
Oct 16 07:32:02 user nova-compute[74080]:   <memory unit='KiB'>524288</memory>
Oct 16 07:32:02 user nova-compute[74080]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 07:32:02 user nova-compute[74080]:   <vcpu placement='static'>1</vcpu>
Oct 16 07:32:02 user nova-compute[74080]:   <resource>
Oct 16 07:32:02 user nova-compute[74080]:     <partition>/machine</partition>
Oct 16 07:32:02 user nova-compute[74080]:   </resource>
Oct 16 07:32:02 user nova-compute[74080]:   <sysinfo type='smbios'>
Oct 16 07:32:02 user nova-compute[74080]:     <system>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='version'>0.0.0</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='serial'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='uuid'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='family'>Virtual Machine</entry>
Oct 16 07:32:02 user nova-compute[74080]:     </system>
Oct 16 07:32:02 user nova-compute[74080]:   </sysinfo>
Oct 16 07:32:02 user nova-compute[74080]:   <os>
Oct 16 07:32:02 user nova-compute[74080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 07:32:02 user nova-compute[74080]:     <boot dev='hd'/>
Oct 16 07:32:02 user nova-compute[74080]:     <smbios mode='sysinfo'/>
Oct 16 07:32:02 user nova-compute[74080]:   </os>
Oct 16 07:32:02 user nova-compute[74080]:   <features>
Oct 16 07:32:02 user nova-compute[74080]:     <acpi/>
Oct 16 07:32:02 user nova-compute[74080]:     <apic/>
Oct 16 07:32:02 user nova-compute[74080]:     <vmcoreinfo state='on'/>
Oct 16 07:32:02 user nova-compute[74080]:   </features>
Oct 16 07:32:02 user nova-compute[74080]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 07:32:02 user nova-compute[74080]:     <model fallback='forbid'>Nehalem</model>
Oct 16 07:32:02 user nova-compute[74080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 07:32:02 user nova-compute[74080]:     <feature policy='require' name='vme'/>
Oct 16 07:32:02 user nova-compute[74080]:     <feature policy='require' name='x2apic'/>
Oct 16 07:32:02 user nova-compute[74080]:     <feature policy='require' name='hypervisor'/>
Oct 16 07:32:02 user nova-compute[74080]:   </cpu>
Oct 16 07:32:02 user nova-compute[74080]:   <clock offset='utc'>
Oct 16 07:32:02 user nova-compute[74080]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 07:32:02 user nova-compute[74080]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 07:32:02 user nova-compute[74080]:     <timer name='hpet' present='no'/>
Oct 16 07:32:02 user nova-compute[74080]:   </clock>
Oct 16 07:32:02 user nova-compute[74080]:   <on_poweroff>destroy</on_poweroff>
Oct 16 07:32:02 user nova-compute[74080]:   <on_reboot>restart</on_reboot>
Oct 16 07:32:02 user nova-compute[74080]:   <on_crash>destroy</on_crash>
Oct 16 07:32:02 user nova-compute[74080]:   <devices>
Oct 16 07:32:02 user nova-compute[74080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 07:32:02 user nova-compute[74080]:     <disk type='file' device='disk'>
Oct 16 07:32:02 user nova-compute[74080]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 07:32:02 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk' index='2'/>
Oct 16 07:32:02 user nova-compute[74080]:       <backingStore type='file' index='3'>
Oct 16 07:32:02 user nova-compute[74080]:         <format type='raw'/>
Oct 16 07:32:02 user nova-compute[74080]:         <source file='/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca'/>
Oct 16 07:32:02 user nova-compute[74080]:         <backingStore/>
Oct 16 07:32:02 user nova-compute[74080]:       </backingStore>
Oct 16 07:32:02 user nova-compute[74080]:       <target dev='vda' bus='virtio'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='virtio-disk0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </disk>
Oct 16 07:32:02 user nova-compute[74080]:     <disk type='file' device='cdrom'>
Oct 16 07:32:02 user nova-compute[74080]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 07:32:02 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config' index='1'/>
Oct 16 07:32:02 user nova-compute[74080]:       <backingStore/>
Oct 16 07:32:02 user nova-compute[74080]:       <target dev='hda' bus='ide'/>
Oct 16 07:32:02 user nova-compute[74080]:       <readonly/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='ide0-0-0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </disk>
Oct 16 07:32:02 user nova-compute[74080]:     <controller type='usb' index='0' model='none'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='usb'/>
Oct 16 07:32:02 user nova-compute[74080]:     </controller>
Oct 16 07:32:02 user nova-compute[74080]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='pci.0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </controller>
Oct 16 07:32:02 user nova-compute[74080]:     <controller type='ide' index='0'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='ide'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 07:32:02 user nova-compute[74080]:     </controller>
Oct 16 07:32:02 user nova-compute[74080]:     <interface type='ethernet'>
Oct 16 07:32:02 user nova-compute[74080]:       <mac address='fa:16:3e:2f:6f:2b'/>
Oct 16 07:32:02 user nova-compute[74080]:       <target dev='tap7d924de9-0e'/>
Oct 16 07:32:02 user nova-compute[74080]:       <model type='virtio'/>
Oct 16 07:32:02 user nova-compute[74080]:       <mtu size='1442'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='net0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </interface>
Oct 16 07:32:02 user nova-compute[74080]:     <serial type='pty'>
Oct 16 07:32:02 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:32:02 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:32:02 user nova-compute[74080]:       <target type='isa-serial' port='0'>
Oct 16 07:32:02 user nova-compute[74080]:         <model name='isa-serial'/>
Oct 16 07:32:02 user nova-compute[74080]:       </target>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </serial>
Oct 16 07:32:02 user nova-compute[74080]:     <console type='pty' tty='/dev/pts/4'>
Oct 16 07:32:02 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:32:02 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:32:02 user nova-compute[74080]:       <target type='serial' port='0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </console>
Oct 16 07:32:02 user nova-compute[74080]:     <input type='mouse' bus='ps2'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='input0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </input>
Oct 16 07:32:02 user nova-compute[74080]:     <input type='keyboard' bus='ps2'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='input1'/>
Oct 16 07:32:02 user nova-compute[74080]:     </input>
Oct 16 07:32:02 user nova-compute[74080]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 16 07:32:02 user nova-compute[74080]:       <listen type='address' address='0.0.0.0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </graphics>
Oct 16 07:32:02 user nova-compute[74080]:     <audio id='1' type='none'/>
Oct 16 07:32:02 user nova-compute[74080]:     <video>
Oct 16 07:32:02 user nova-compute[74080]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='video0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </video>
Oct 16 07:32:02 user nova-compute[74080]:     <memballoon model='virtio'>
Oct 16 07:32:02 user nova-compute[74080]:       <stats period='10'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='balloon0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </memballoon>
Oct 16 07:32:02 user nova-compute[74080]:     <rng model='virtio'>
Oct 16 07:32:02 user nova-compute[74080]:       <backend model='random'>/dev/urandom</backend>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='rng0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </rng>
Oct 16 07:32:02 user nova-compute[74080]:   </devices>
Oct 16 07:32:02 user nova-compute[74080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 07:32:02 user nova-compute[74080]:     <label>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</label>
Oct 16 07:32:02 user nova-compute[74080]:     <imagelabel>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</imagelabel>
Oct 16 07:32:02 user nova-compute[74080]:   </seclabel>
Oct 16 07:32:02 user nova-compute[74080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 07:32:02 user nova-compute[74080]:     <label>+64055:+108</label>
Oct 16 07:32:02 user nova-compute[74080]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 07:32:02 user nova-compute[74080]:   </seclabel>
Oct 16 07:32:02 user nova-compute[74080]: </domain>
Oct 16 07:32:02 user nova-compute[74080]:  {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface> {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fd:52:14"/><model type="virtio"/><mtu size="1442"/><target dev="tap1616715e-9a"/></interface>not found in domain: <domain type='kvm' id='5'>
Oct 16 07:32:02 user nova-compute[74080]:   <name>instance-00000005</name>
Oct 16 07:32:02 user nova-compute[74080]:   <uuid>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</uuid>
Oct 16 07:32:02 user nova-compute[74080]:   <metadata>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:32:02 user nova-compute[74080]:   <nova:package version="0.0.0"/>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:creationTime>2023-10-16 07:32:01</nova:creationTime>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:flavor name="m1.tiny">
Oct 16 07:32:02 user nova-compute[74080]:     <nova:memory>512</nova:memory>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:disk>1</nova:disk>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:swap>0</nova:swap>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:vcpus>1</nova:vcpus>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:flavor>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:owner>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:owner>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:ports>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:32:02 user nova-compute[74080]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:32:02 user nova-compute[74080]:     </nova:port>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:ports>
Oct 16 07:32:02 user nova-compute[74080]: </nova:instance>
Oct 16 07:32:02 user nova-compute[74080]:   </metadata>
Oct 16 07:32:02 user nova-compute[74080]:   <memory unit='KiB'>524288</memory>
Oct 16 07:32:02 user nova-compute[74080]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 07:32:02 user nova-compute[74080]:   <vcpu placement='static'>1</vcpu>
Oct 16 07:32:02 user nova-compute[74080]:   <resource>
Oct 16 07:32:02 user nova-compute[74080]:     <partition>/machine</partition>
Oct 16 07:32:02 user nova-compute[74080]:   </resource>
Oct 16 07:32:02 user nova-compute[74080]:   <sysinfo type='smbios'>
Oct 16 07:32:02 user nova-compute[74080]:     <system>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='version'>0.0.0</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='serial'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='uuid'>3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</entry>
Oct 16 07:32:02 user nova-compute[74080]:       <entry name='family'>Virtual Machine</entry>
Oct 16 07:32:02 user nova-compute[74080]:     </system>
Oct 16 07:32:02 user nova-compute[74080]:   </sysinfo>
Oct 16 07:32:02 user nova-compute[74080]:   <os>
Oct 16 07:32:02 user nova-compute[74080]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 07:32:02 user nova-compute[74080]:     <boot dev='hd'/>
Oct 16 07:32:02 user nova-compute[74080]:     <smbios mode='sysinfo'/>
Oct 16 07:32:02 user nova-compute[74080]:   </os>
Oct 16 07:32:02 user nova-compute[74080]:   <features>
Oct 16 07:32:02 user nova-compute[74080]:     <acpi/>
Oct 16 07:32:02 user nova-compute[74080]:     <apic/>
Oct 16 07:32:02 user nova-compute[74080]:     <vmcoreinfo state='on'/>
Oct 16 07:32:02 user nova-compute[74080]:   </features>
Oct 16 07:32:02 user nova-compute[74080]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 07:32:02 user nova-compute[74080]:     <model fallback='forbid'>Nehalem</model>
Oct 16 07:32:02 user nova-compute[74080]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 07:32:02 user nova-compute[74080]:     <feature policy='require' name='vme'/>
Oct 16 07:32:02 user nova-compute[74080]:     <feature policy='require' name='x2apic'/>
Oct 16 07:32:02 user nova-compute[74080]:     <feature policy='require' name='hypervisor'/>
Oct 16 07:32:02 user nova-compute[74080]:   </cpu>
Oct 16 07:32:02 user nova-compute[74080]:   <clock offset='utc'>
Oct 16 07:32:02 user nova-compute[74080]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 07:32:02 user nova-compute[74080]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 07:32:02 user nova-compute[74080]:     <timer name='hpet' present='no'/>
Oct 16 07:32:02 user nova-compute[74080]:   </clock>
Oct 16 07:32:02 user nova-compute[74080]:   <on_poweroff>destroy</on_poweroff>
Oct 16 07:32:02 user nova-compute[74080]:   <on_reboot>restart</on_reboot>
Oct 16 07:32:02 user nova-compute[74080]:   <on_crash>destroy</on_crash>
Oct 16 07:32:02 user nova-compute[74080]:   <devices>
Oct 16 07:32:02 user nova-compute[74080]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 07:32:02 user nova-compute[74080]:     <disk type='file' device='disk'>
Oct 16 07:32:02 user nova-compute[74080]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 07:32:02 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk' index='2'/>
Oct 16 07:32:02 user nova-compute[74080]:       <backingStore type='file' index='3'>
Oct 16 07:32:02 user nova-compute[74080]:         <format type='raw'/>
Oct 16 07:32:02 user nova-compute[74080]:         <source file='/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca'/>
Oct 16 07:32:02 user nova-compute[74080]:         <backingStore/>
Oct 16 07:32:02 user nova-compute[74080]:       </backingStore>
Oct 16 07:32:02 user nova-compute[74080]:       <target dev='vda' bus='virtio'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='virtio-disk0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </disk>
Oct 16 07:32:02 user nova-compute[74080]:     <disk type='file' device='cdrom'>
Oct 16 07:32:02 user nova-compute[74080]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 07:32:02 user nova-compute[74080]:       <source file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk.config' index='1'/>
Oct 16 07:32:02 user nova-compute[74080]:       <backingStore/>
Oct 16 07:32:02 user nova-compute[74080]:       <target dev='hda' bus='ide'/>
Oct 16 07:32:02 user nova-compute[74080]:       <readonly/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='ide0-0-0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </disk>
Oct 16 07:32:02 user nova-compute[74080]:     <controller type='usb' index='0' model='none'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='usb'/>
Oct 16 07:32:02 user nova-compute[74080]:     </controller>
Oct 16 07:32:02 user nova-compute[74080]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='pci.0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </controller>
Oct 16 07:32:02 user nova-compute[74080]:     <controller type='ide' index='0'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='ide'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 07:32:02 user nova-compute[74080]:     </controller>
Oct 16 07:32:02 user nova-compute[74080]:     <interface type='ethernet'>
Oct 16 07:32:02 user nova-compute[74080]:       <mac address='fa:16:3e:2f:6f:2b'/>
Oct 16 07:32:02 user nova-compute[74080]:       <target dev='tap7d924de9-0e'/>
Oct 16 07:32:02 user nova-compute[74080]:       <model type='virtio'/>
Oct 16 07:32:02 user nova-compute[74080]:       <mtu size='1442'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='net0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </interface>
Oct 16 07:32:02 user nova-compute[74080]:     <serial type='pty'>
Oct 16 07:32:02 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:32:02 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:32:02 user nova-compute[74080]:       <target type='isa-serial' port='0'>
Oct 16 07:32:02 user nova-compute[74080]:         <model name='isa-serial'/>
Oct 16 07:32:02 user nova-compute[74080]:       </target>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </serial>
Oct 16 07:32:02 user nova-compute[74080]:     <console type='pty' tty='/dev/pts/4'>
Oct 16 07:32:02 user nova-compute[74080]:       <source path='/dev/pts/4'/>
Oct 16 07:32:02 user nova-compute[74080]:       <log file='/opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/console.log' append='off'/>
Oct 16 07:32:02 user nova-compute[74080]:       <target type='serial' port='0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='serial0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </console>
Oct 16 07:32:02 user nova-compute[74080]:     <input type='mouse' bus='ps2'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='input0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </input>
Oct 16 07:32:02 user nova-compute[74080]:     <input type='keyboard' bus='ps2'>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='input1'/>
Oct 16 07:32:02 user nova-compute[74080]:     </input>
Oct 16 07:32:02 user nova-compute[74080]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Oct 16 07:32:02 user nova-compute[74080]:       <listen type='address' address='0.0.0.0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </graphics>
Oct 16 07:32:02 user nova-compute[74080]:     <audio id='1' type='none'/>
Oct 16 07:32:02 user nova-compute[74080]:     <video>
Oct 16 07:32:02 user nova-compute[74080]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='video0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </video>
Oct 16 07:32:02 user nova-compute[74080]:     <memballoon model='virtio'>
Oct 16 07:32:02 user nova-compute[74080]:       <stats period='10'/>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='balloon0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </memballoon>
Oct 16 07:32:02 user nova-compute[74080]:     <rng model='virtio'>
Oct 16 07:32:02 user nova-compute[74080]:       <backend model='random'>/dev/urandom</backend>
Oct 16 07:32:02 user nova-compute[74080]:       <alias name='rng0'/>
Oct 16 07:32:02 user nova-compute[74080]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 07:32:02 user nova-compute[74080]:     </rng>
Oct 16 07:32:02 user nova-compute[74080]:   </devices>
Oct 16 07:32:02 user nova-compute[74080]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 07:32:02 user nova-compute[74080]:     <label>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</label>
Oct 16 07:32:02 user nova-compute[74080]:     <imagelabel>libvirt-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b</imagelabel>
Oct 16 07:32:02 user nova-compute[74080]:   </seclabel>
Oct 16 07:32:02 user nova-compute[74080]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 07:32:02 user nova-compute[74080]:     <label>+64055:+108</label>
Oct 16 07:32:02 user nova-compute[74080]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 07:32:02 user nova-compute[74080]:   </seclabel>
Oct 16 07:32:02 user nova-compute[74080]: </domain>
Oct 16 07:32:02 user nova-compute[74080]:  {{(pid=74080) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 07:32:02 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Detaching interface fa:16:3e:fd:52:14 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap1616715e-9a' not found.
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.network.os_vif_util [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Converting VIF {"id": "1616715e-9ab5-455f-a830-459d6ea63e83", "address": "fa:16:3e:fd:52:14", "network": {"id": "a26127af-b495-48b0-90df-a8c11b94ec6d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1485140611", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1616715e-9a", "ovs_interfaceid": "1616715e-9ab5-455f-a830-459d6ea63e83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.network.os_vif_util [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_vif [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1616715e-9a, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:32:02 user nova-compute[74080]: INFO os_vif [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:14,bridge_name='br-int',has_traffic_filtering=True,id=1616715e-9ab5-455f-a830-459d6ea63e83,network=Network(a26127af-b495-48b0-90df-a8c11b94ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1616715e-9a')
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [req-ca2c3cd2-78ce-4580-b708-7f5e537ecf01 req-ec631388-070e-4b6d-ba0d-6ca4bbe5bb16 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:32:02 user nova-compute[74080]:   <nova:package version="0.0.0"/>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:name>tempest-device-tagging-server-536006916</nova:name>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:creationTime>2023-10-16 07:32:02</nova:creationTime>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:flavor name="m1.tiny">
Oct 16 07:32:02 user nova-compute[74080]:     <nova:memory>512</nova:memory>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:disk>1</nova:disk>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:swap>0</nova:swap>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:vcpus>1</nova:vcpus>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:flavor>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:owner>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:user uuid="b60dc9148587426ebd0b15ddb70a3139">tempest-TaggedAttachmentsTest-1912564389-project-member</nova:user>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:project uuid="c1c006491b0f449394c55b7024a19bb6">tempest-TaggedAttachmentsTest-1912564389</nova:project>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:owner>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:32:02 user nova-compute[74080]:   <nova:ports>
Oct 16 07:32:02 user nova-compute[74080]:     <nova:port uuid="7d924de9-0e44-4edf-992f-d94e6d91a876">
Oct 16 07:32:02 user nova-compute[74080]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:32:02 user nova-compute[74080]:     </nova:port>
Oct 16 07:32:02 user nova-compute[74080]:   </nova:ports>
Oct 16 07:32:02 user nova-compute[74080]: </nova:instance>
Oct 16 07:32:02 user nova-compute[74080]:  {{(pid=74080) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 07:32:02 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 is timed out.
Oct 16 07:32:02 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Successfully detached device sdc from instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91 from the live domain config.
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOwDIXGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:32:02 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.network.neutron [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [{"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1971a3a7-b3de-4da8-8eb2-35c56172787f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:32:02 user nova-compute[74080]: No targets found.
Oct 16 07:32:02 user nova-compute[74080]: iSNS:
Oct 16 07:32:02 user nova-compute[74080]: No targets found.
Oct 16 07:32:02 user nova-compute[74080]: STATIC:
Oct 16 07:32:02 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c
Oct 16 07:32:02 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:02 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:02 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb
Oct 16 07:32:02 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:02 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:02 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:32:02 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:02 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:02 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:32:02 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:02 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:02 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:32:02 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:02 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:02 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:32:02 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:02 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:02 user nova-compute[74080]: FIRMWARE:
Oct 16 07:32:02 user nova-compute[74080]: No targets found.
Oct 16 07:32:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:32:02 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:32:02 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.objects.instance [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lazy-loading 'flavor' on Instance uuid 34cb3aed-3c32-460c-adb1-ab9c176be198 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Releasing lock "refresh_cache-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b80ef4-cf23-4371-bf11-e232c4934e78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a77458d5-a5f4-4895-90fa-4da32ac0b7c9 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "interface-3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-1616715e-9ab5-455f-a830-459d6ea63e83" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.794s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa2d9f-50c0-4c33-8a0a-fcff9d5472a8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:02 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac37f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c'): ({'sdf'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Removing single pathed devices sdf {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a41299d6-3d58-4119-a1ba-3e0aa31ddb59 tempest-VolumesAssistedSnapshotsTest-439987191 tempest-VolumesAssistedSnapshotsTest-439987191-project-admin] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.342s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa6421-4e8e-45f1-80de-bbee983f8225]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d286141-3081-46b3-925a-751e5c3976ad]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Flushing IO for device /dev/sdf {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e1a9c-7880-4ce7-a0bd-60d15fa274fd]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa451864-c510-43a3-9e94-33884a698b04]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd35995-0de1-475e-9aa6-891b0f43dc31]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490a3c0-0a9c-4f13-978c-8e833a4a7a66]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260]
Oct 16 07:32:02 user nova-compute[74080]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c, portal: 172.16.0.220,3260] successful.
Oct 16 07:32:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28a4ffc9-c174-4b6a-931f-adbb8282f99c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68da4a0-eda7-49c1-8442-ee7fb69cc983]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] <== disconnect_volume: return (380ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:32:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:32:03 user nova-compute[74080]: DEBUG nova.objects.instance [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lazy-loading 'flavor' on Instance uuid 5e0bc1db-0c8e-400b-814c-da5b19e74b91 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-845e0c2e-6b60-4ad5-bf05-0f80c02fa074 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.901s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:04 user nova-compute[74080]: INFO nova.compute.manager [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Terminating instance
Oct 16 07:32:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-9dd54105-5f23-40f1-a61d-d2a19f33fc37 req-bb865dc7-b0e9-49b5-a514-0b8204e9759b service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-vif-unplugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9dd54105-5f23-40f1-a61d-d2a19f33fc37 req-bb865dc7-b0e9-49b5-a514-0b8204e9759b service nova] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9dd54105-5f23-40f1-a61d-d2a19f33fc37 req-bb865dc7-b0e9-49b5-a514-0b8204e9759b service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9dd54105-5f23-40f1-a61d-d2a19f33fc37 req-bb865dc7-b0e9-49b5-a514-0b8204e9759b service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-9dd54105-5f23-40f1-a61d-d2a19f33fc37 req-bb865dc7-b0e9-49b5-a514-0b8204e9759b service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] No waiting events found dispatching network-vif-unplugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-9dd54105-5f23-40f1-a61d-d2a19f33fc37 req-bb865dc7-b0e9-49b5-a514-0b8204e9759b service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-vif-unplugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Instance destroyed successfully.
Oct 16 07:32:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lazy-loading 'resources' on Instance uuid 5e0bc1db-0c8e-400b-814c-da5b19e74b91 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1255670706',display_name='tempest-AttachSCSIVolumeTestJSON-server-1255670706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1255670706',id=6,image_ref='71d403eb-cb21-41d8-b469-8f26f2b1e23d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+T/FWygI73lXgVWqpGbqIOsSrVKd6DBPaSaS7IJKbc8ShYsjbebH6l31+26/VHSRbsEe0pD8//STUjYH8Fiq5PQxVHt/oG8SPbmKJSfsSghBJBAOtRUw/gJ9BrS1U8Kw==',key_name='tempest-keypair-1101819471',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b62034e9a9464aa28d72ba8ae3333c54',ramdisk_id='',reservation_id='r-im4pyxoi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='71d403eb-cb21-41d8-b469-8f26f2b1e23d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1829758216',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1829758216-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b8cd76ab7a4d68b4f2826dc95e6eb1',uuid=5e0bc1db-0c8e-400b-814c-da5b19e74b91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Converting VIF {"id": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "address": "fa:16:3e:43:27:34", "network": {"id": "ef9c177b-20ca-4797-a4d5-83d83af3ecf1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-645564488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b62034e9a9464aa28d72ba8ae3333c54", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9122dc8-47", "ovs_interfaceid": "c9122dc8-4754-4fe0-84cc-9c119964eb16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:27:34,bridge_name='br-int',has_traffic_filtering=True,id=c9122dc8-4754-4fe0-84cc-9c119964eb16,network=Network(ef9c177b-20ca-4797-a4d5-83d83af3ecf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9122dc8-47') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG os_vif [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:27:34,bridge_name='br-int',has_traffic_filtering=True,id=c9122dc8-4754-4fe0-84cc-9c119964eb16,network=Network(ef9c177b-20ca-4797-a4d5-83d83af3ecf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9122dc8-47') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9122dc8-47, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6591b3e5-4556-4874-a5aa-dea916ef960e) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:05 user nova-compute[74080]: INFO os_vif [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:27:34,bridge_name='br-int',has_traffic_filtering=True,id=c9122dc8-4754-4fe0-84cc-9c119964eb16,network=Network(ef9c177b-20ca-4797-a4d5-83d83af3ecf1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9122dc8-47')
Oct 16 07:32:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Deleting instance files /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91_del
Oct 16 07:32:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Deletion of /opt/stack/data/nova/instances/5e0bc1db-0c8e-400b-814c-da5b19e74b91_del complete
Oct 16 07:32:05 user nova-compute[74080]: INFO nova.compute.manager [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 16 07:32:05 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:32:05 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:06 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Took 0.91 seconds to deallocate network for instance.
Oct 16 07:32:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:06 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Deleted allocations for instance 5e0bc1db-0c8e-400b-814c-da5b19e74b91
Oct 16 07:32:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-5ef121f1-96fc-4c4f-be5e-67a2f763995e req-fa68bbd6-f88f-459b-bfa5-9e342c6d5d3e service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5ef121f1-96fc-4c4f-be5e-67a2f763995e req-fa68bbd6-f88f-459b-bfa5-9e342c6d5d3e service nova] Acquiring lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5ef121f1-96fc-4c4f-be5e-67a2f763995e req-fa68bbd6-f88f-459b-bfa5-9e342c6d5d3e service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5ef121f1-96fc-4c4f-be5e-67a2f763995e req-fa68bbd6-f88f-459b-bfa5-9e342c6d5d3e service nova] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-5ef121f1-96fc-4c4f-be5e-67a2f763995e req-fa68bbd6-f88f-459b-bfa5-9e342c6d5d3e service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] No waiting events found dispatching network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:06 user nova-compute[74080]: WARNING nova.compute.manager [req-5ef121f1-96fc-4c4f-be5e-67a2f763995e req-fa68bbd6-f88f-459b-bfa5-9e342c6d5d3e service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received unexpected event network-vif-plugged-c9122dc8-4754-4fe0-84cc-9c119964eb16 for instance with vm_state deleted and task_state None.
Oct 16 07:32:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-5ef121f1-96fc-4c4f-be5e-67a2f763995e req-fa68bbd6-f88f-459b-bfa5-9e342c6d5d3e service nova] [instance: 5e0bc1db-0c8e-400b-814c-da5b19e74b91] Received event network-vif-deleted-c9122dc8-4754-4fe0-84cc-9c119964eb16 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d2c1a191-3ed9-4de2-80b7-287e11ce2152 tempest-AttachSCSIVolumeTestJSON-1829758216 tempest-AttachSCSIVolumeTestJSON-1829758216-project-member] Lock "5e0bc1db-0c8e-400b-814c-da5b19e74b91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "41a5c934-14d2-469f-9fe6-d175ae886673" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "41a5c934-14d2-469f-9fe6-d175ae886673" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Starting finish_migration {{(pid=74080) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance directory exists: not creating {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 07:32:08 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Creating image(s)
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:32:08 user nova-compute[74080]: INFO nova.compute.claims [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Claim successful on node user
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.225s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk. size=21474836480 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk 21474836480 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk 21474836480" returned: 0 in 0.062s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Ensure instance console log exists: /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Start _get_guest_xml network_info=[{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-747411497-network", "vif_mac": "fa:16:3e:29:3d:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '02776335-ba8f-4894-8227-48ad98946762', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e4b3aaca-821e-410f-83c1-7287a48c7723', 'attached_at': '2023-10-16T07:32:08.000000', 'detached_at': '', 'volume_id': '2ca08889-064b-4c5b-99bf-069fe6a32805', 'serial': '2ca08889-064b-4c5b-99bf-069fe6a32805'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:32:08 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:32:08 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:32:08 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:32:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:32:08 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:32:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:32:08 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a568ae1-23c0-48a8-ada2-5b1fcbcc777b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:32:08 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[997724ed-2f28-4553-9b9f-f6dd412a933f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805] added
Oct 16 07:32:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff79b121-89e6-4dfa-9c98-96b9792b4a27]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b5746-6024-482c-b9ec-f233dd73d075]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAKLEMOy {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAKLEMOy" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c13cbd5-cfc4-4e02-8ca5-0d51aa88d340]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.network.neutron [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JAKLEMOy'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f47dab-06bb-4869-9244-1741ba4f6e0b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfaa5cb-bf0b-463d-a6f5-19f5726f4af4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.policy [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebb8d2a523034e03b8bb5f09d5f720fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2464ccb4f24e319dadbd7d2edd64fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39739c-e8e6-4629-a3da-7a413d6cd40f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]
Oct 16 07:32:09 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.
Oct 16 07:32:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:32:09 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Creating image(s)
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "/opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "/opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "/opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[83280c25-998b-42f2-b209-67e477c0d385]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[162c06d9-da12-4dd0-88c2-2eb18f76d5b7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:09 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.051s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[517a5efa-04b2-4cb3-b229-15b705fd71e9]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk 1073741824" returned: 0 in 0.046s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.221s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:32:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Cannot resize image /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Ensure instance console log exists: /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.neutron [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Successfully created port: 98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '26632656334613731', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632656334613731', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-747411497-network", "vif_mac": "fa:16:3e:29:3d:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-747411497-network", "vif_mac": "fa:16:3e:29:3d:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:32:10 user nova-compute[74080]:   <uuid>e4b3aaca-821e-410f-83c1-7287a48c7723</uuid>
Oct 16 07:32:10 user nova-compute[74080]:   <name>instance-00000002</name>
Oct 16 07:32:10 user nova-compute[74080]:   <memory>2097152</memory>
Oct 16 07:32:10 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:32:10 user nova-compute[74080]:   <metadata>
Oct 16 07:32:10 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:32:10 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:32:10 user nova-compute[74080]:       <nova:name>tempest-ServerActionsTestOtherB-server-1311694320</nova:name>
Oct 16 07:32:10 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:32:08</nova:creationTime>
Oct 16 07:32:10 user nova-compute[74080]:       <nova:flavor name="m1.small">
Oct 16 07:32:10 user nova-compute[74080]:         <nova:memory>2048</nova:memory>
Oct 16 07:32:10 user nova-compute[74080]:         <nova:disk>20</nova:disk>
Oct 16 07:32:10 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:32:10 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:32:10 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:32:10 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:32:10 user nova-compute[74080]:       <nova:owner>
Oct 16 07:32:10 user nova-compute[74080]:         <nova:user uuid="5bba0d0c7a2d4fb3a757aa0abdfa1a2e">tempest-ServerActionsTestOtherB-885127344-project-member</nova:user>
Oct 16 07:32:10 user nova-compute[74080]:         <nova:project uuid="0746934362024577ae7fd2846d1c2ec7">tempest-ServerActionsTestOtherB-885127344</nova:project>
Oct 16 07:32:10 user nova-compute[74080]:       </nova:owner>
Oct 16 07:32:10 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:32:10 user nova-compute[74080]:       <nova:ports>
Oct 16 07:32:10 user nova-compute[74080]:         <nova:port uuid="1184cb83-61e9-4582-9ff1-1a62d2e9f4a4">
Oct 16 07:32:10 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:32:10 user nova-compute[74080]:         </nova:port>
Oct 16 07:32:10 user nova-compute[74080]:       </nova:ports>
Oct 16 07:32:10 user nova-compute[74080]:     </nova:instance>
Oct 16 07:32:10 user nova-compute[74080]:   </metadata>
Oct 16 07:32:10 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:32:10 user nova-compute[74080]:     <system>
Oct 16 07:32:10 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:32:10 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:32:10 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:32:10 user nova-compute[74080]:       <entry name="serial">e4b3aaca-821e-410f-83c1-7287a48c7723</entry>
Oct 16 07:32:10 user nova-compute[74080]:       <entry name="uuid">e4b3aaca-821e-410f-83c1-7287a48c7723</entry>
Oct 16 07:32:10 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:32:10 user nova-compute[74080]:     </system>
Oct 16 07:32:10 user nova-compute[74080]:   </sysinfo>
Oct 16 07:32:10 user nova-compute[74080]:   <os>
Oct 16 07:32:10 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:32:10 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:32:10 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:32:10 user nova-compute[74080]:   </os>
Oct 16 07:32:10 user nova-compute[74080]:   <features>
Oct 16 07:32:10 user nova-compute[74080]:     <acpi/>
Oct 16 07:32:10 user nova-compute[74080]:     <apic/>
Oct 16 07:32:10 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:32:10 user nova-compute[74080]:   </features>
Oct 16 07:32:10 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:32:10 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:32:10 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:32:10 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:32:10 user nova-compute[74080]:   </clock>
Oct 16 07:32:10 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:32:10 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:32:10 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:32:10 user nova-compute[74080]:   </cpu>
Oct 16 07:32:10 user nova-compute[74080]:   <devices>
Oct 16 07:32:10 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:32:10 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:32:10 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk"/>
Oct 16 07:32:10 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:32:10 user nova-compute[74080]:     </disk>
Oct 16 07:32:10 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:32:10 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:32:10 user nova-compute[74080]:       <source dev="/dev/sdf"/>
Oct 16 07:32:10 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:32:10 user nova-compute[74080]:       <serial>2ca08889-064b-4c5b-99bf-069fe6a32805</serial>
Oct 16 07:32:10 user nova-compute[74080]:     </disk>
Oct 16 07:32:10 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:32:10 user nova-compute[74080]:       <mac address="fa:16:3e:29:3d:72"/>
Oct 16 07:32:10 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:32:10 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:32:10 user nova-compute[74080]:       <target dev="tap1184cb83-61"/>
Oct 16 07:32:10 user nova-compute[74080]:     </interface>
Oct 16 07:32:10 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:32:10 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/console.log" append="off"/>
Oct 16 07:32:10 user nova-compute[74080]:     </serial>
Oct 16 07:32:10 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:32:10 user nova-compute[74080]:     <video>
Oct 16 07:32:10 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:32:10 user nova-compute[74080]:     </video>
Oct 16 07:32:10 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:32:10 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:32:10 user nova-compute[74080]:     </rng>
Oct 16 07:32:10 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:32:10 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:32:10 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:32:10 user nova-compute[74080]:     </memballoon>
Oct 16 07:32:10 user nova-compute[74080]:   </devices>
Oct 16 07:32:10 user nova-compute[74080]: </domain>
Oct 16 07:32:10 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-747411497-network", "vif_mac": "fa:16:3e:29:3d:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-747411497-network", "vif_mac": "fa:16:3e:29:3d:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG os_vif [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45442e9b-be3e-5f95-8bbe-c9eede3e2487', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1184cb83-61, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1184cb83-61, col_values=(('qos', UUID('a0231991-5832-4c86-9833-b0884bd4ce69')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1184cb83-61, col_values=(('external_ids', {'iface-id': '1184cb83-61e9-4582-9ff1-1a62d2e9f4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:3d:72', 'vm-uuid': 'e4b3aaca-821e-410f-83c1-7287a48c7723'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:10 user nova-compute[74080]: INFO os_vif [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61')
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] No VIF found with MAC fa:16:3e:29:3d:72, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.neutron [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Successfully updated port: 98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "refresh_cache-41a5c934-14d2-469f-9fe6-d175ae886673" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquired lock "refresh_cache-41a5c934-14d2-469f-9fe6-d175ae886673" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.neutron [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received event network-changed-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Refreshing instance network info cache due to event network-changed-98d032a8-cc77-476b-8bda-b1a00d4473a6. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] Acquiring lock "refresh_cache-41a5c934-14d2-469f-9fe6-d175ae886673" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:32:10 user nova-compute[74080]: DEBUG nova.network.neutron [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.neutron [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Updating instance_info_cache with network_info: [{"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Releasing lock "refresh_cache-41a5c934-14d2-469f-9fe6-d175ae886673" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Instance network_info: |[{"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] Acquired lock "refresh_cache-41a5c934-14d2-469f-9fe6-d175ae886673" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.neutron [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Refreshing network info cache for port 98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Start _get_guest_xml network_info=[{"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:32:11 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:32:11 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127629370',display_name='tempest-VolumesAdminNegativeTest-server-2127629370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127629370',id=12,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2464ccb4f24e319dadbd7d2edd64fd',ramdisk_id='',reservation_id='r-o6lvffg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1570382741',owner_user_name='tempest-VolumesAdminNegativeTest-1570382741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:32:09Z,user_data=None,user_id='ebb8d2a523034e03b8bb5f09d5f720fa',uuid=41a5c934-14d2-469f-9fe6-d175ae886673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converting VIF {"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=98d032a8-cc77-476b-8bda-b1a00d4473a6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d032a8-cc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.objects.instance [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lazy-loading 'pci_devices' on Instance uuid 41a5c934-14d2-469f-9fe6-d175ae886673 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:32:11 user nova-compute[74080]:   <uuid>41a5c934-14d2-469f-9fe6-d175ae886673</uuid>
Oct 16 07:32:11 user nova-compute[74080]:   <name>instance-0000000c</name>
Oct 16 07:32:11 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:32:11 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:32:11 user nova-compute[74080]:   <metadata>
Oct 16 07:32:11 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:32:11 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:32:11 user nova-compute[74080]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2127629370</nova:name>
Oct 16 07:32:11 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:32:11</nova:creationTime>
Oct 16 07:32:11 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:32:11 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:32:11 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:32:11 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:32:11 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:32:11 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:32:11 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:32:11 user nova-compute[74080]:       <nova:owner>
Oct 16 07:32:11 user nova-compute[74080]:         <nova:user uuid="ebb8d2a523034e03b8bb5f09d5f720fa">tempest-VolumesAdminNegativeTest-1570382741-project-member</nova:user>
Oct 16 07:32:11 user nova-compute[74080]:         <nova:project uuid="5c2464ccb4f24e319dadbd7d2edd64fd">tempest-VolumesAdminNegativeTest-1570382741</nova:project>
Oct 16 07:32:11 user nova-compute[74080]:       </nova:owner>
Oct 16 07:32:11 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:32:11 user nova-compute[74080]:       <nova:ports>
Oct 16 07:32:11 user nova-compute[74080]:         <nova:port uuid="98d032a8-cc77-476b-8bda-b1a00d4473a6">
Oct 16 07:32:11 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 07:32:11 user nova-compute[74080]:         </nova:port>
Oct 16 07:32:11 user nova-compute[74080]:       </nova:ports>
Oct 16 07:32:11 user nova-compute[74080]:     </nova:instance>
Oct 16 07:32:11 user nova-compute[74080]:   </metadata>
Oct 16 07:32:11 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:32:11 user nova-compute[74080]:     <system>
Oct 16 07:32:11 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:32:11 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:32:11 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:32:11 user nova-compute[74080]:       <entry name="serial">41a5c934-14d2-469f-9fe6-d175ae886673</entry>
Oct 16 07:32:11 user nova-compute[74080]:       <entry name="uuid">41a5c934-14d2-469f-9fe6-d175ae886673</entry>
Oct 16 07:32:11 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:32:11 user nova-compute[74080]:     </system>
Oct 16 07:32:11 user nova-compute[74080]:   </sysinfo>
Oct 16 07:32:11 user nova-compute[74080]:   <os>
Oct 16 07:32:11 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:32:11 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:32:11 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:32:11 user nova-compute[74080]:   </os>
Oct 16 07:32:11 user nova-compute[74080]:   <features>
Oct 16 07:32:11 user nova-compute[74080]:     <acpi/>
Oct 16 07:32:11 user nova-compute[74080]:     <apic/>
Oct 16 07:32:11 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:32:11 user nova-compute[74080]:   </features>
Oct 16 07:32:11 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:32:11 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:32:11 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:32:11 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:32:11 user nova-compute[74080]:   </clock>
Oct 16 07:32:11 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:32:11 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:32:11 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:32:11 user nova-compute[74080]:   </cpu>
Oct 16 07:32:11 user nova-compute[74080]:   <devices>
Oct 16 07:32:11 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:32:11 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:32:11 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk"/>
Oct 16 07:32:11 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:32:11 user nova-compute[74080]:     </disk>
Oct 16 07:32:11 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:32:11 user nova-compute[74080]:       <mac address="fa:16:3e:d4:4c:f9"/>
Oct 16 07:32:11 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:32:11 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:32:11 user nova-compute[74080]:       <target dev="tap98d032a8-cc"/>
Oct 16 07:32:11 user nova-compute[74080]:     </interface>
Oct 16 07:32:11 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:32:11 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/console.log" append="off"/>
Oct 16 07:32:11 user nova-compute[74080]:     </serial>
Oct 16 07:32:11 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:32:11 user nova-compute[74080]:     <video>
Oct 16 07:32:11 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:32:11 user nova-compute[74080]:     </video>
Oct 16 07:32:11 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:32:11 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:32:11 user nova-compute[74080]:     </rng>
Oct 16 07:32:11 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:32:11 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:32:11 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:32:11 user nova-compute[74080]:     </memballoon>
Oct 16 07:32:11 user nova-compute[74080]:   </devices>
Oct 16 07:32:11 user nova-compute[74080]: </domain>
Oct 16 07:32:11 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127629370',display_name='tempest-VolumesAdminNegativeTest-server-2127629370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127629370',id=12,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c2464ccb4f24e319dadbd7d2edd64fd',ramdisk_id='',reservation_id='r-o6lvffg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1570382741',owner_user_name='tempest-VolumesAdminNegativeTest-1570382741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:32:09Z,user_data=None,user_id='ebb8d2a523034e03b8bb5f09d5f720fa',uuid=41a5c934-14d2-469f-9fe6-d175ae886673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converting VIF {"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=98d032a8-cc77-476b-8bda-b1a00d4473a6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d032a8-cc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG os_vif [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=98d032a8-cc77-476b-8bda-b1a00d4473a6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d032a8-cc') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e051191-f590-57f2-8652-8607db76cd27', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98d032a8-cc, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98d032a8-cc, col_values=(('qos', UUID('8b89062f-b992-404e-884f-f87b3028b0f9')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98d032a8-cc, col_values=(('external_ids', {'iface-id': '98d032a8-cc77-476b-8bda-b1a00d4473a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:4c:f9', 'vm-uuid': '41a5c934-14d2-469f-9fe6-d175ae886673'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:11 user nova-compute[74080]: INFO os_vif [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=98d032a8-cc77-476b-8bda-b1a00d4473a6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d032a8-cc')
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] No VIF found with MAC fa:16:3e:d4:4c:f9, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.neutron [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Updated VIF entry in instance network info cache for port 98d032a8-cc77-476b-8bda-b1a00d4473a6. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG nova.network.neutron [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Updating instance_info_cache with network_info: [{"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-57dcea0a-1c37-4efb-84a1-4f338e8e6507 req-357bb4ec-e762-41cd-8bd7-b1fc3871fff6 service nova] Releasing lock "refresh_cache-41a5c934-14d2-469f-9fe6-d175ae886673" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-30926460-b4e7-469b-87f4-3918d9889ac1 req-0cdec3ff-d0b4-4e97-9630-e101a4ed310e service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30926460-b4e7-469b-87f4-3918d9889ac1 req-0cdec3ff-d0b4-4e97-9630-e101a4ed310e service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30926460-b4e7-469b-87f4-3918d9889ac1 req-0cdec3ff-d0b4-4e97-9630-e101a4ed310e service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30926460-b4e7-469b-87f4-3918d9889ac1 req-0cdec3ff-d0b4-4e97-9630-e101a4ed310e service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-30926460-b4e7-469b-87f4-3918d9889ac1 req-0cdec3ff-d0b4-4e97-9630-e101a4ed310e service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:12 user nova-compute[74080]: WARNING nova.compute.manager [req-30926460-b4e7-469b-87f4-3918d9889ac1 req-0cdec3ff-d0b4-4e97-9630-e101a4ed310e service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state active and task_state resize_finish.
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating instance_info_cache with network_info: [{"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:14 user nova-compute[74080]: WARNING nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state active and task_state resize_finish.
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received event network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Acquiring lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] No waiting events found dispatching network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:14 user nova-compute[74080]: WARNING nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received unexpected event network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 for instance with vm_state building and task_state spawning.
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received event network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Acquiring lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] No waiting events found dispatching network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:14 user nova-compute[74080]: WARNING nova.compute.manager [req-b6219ed0-8787-415b-a94a-b7b1a52f7a1f req-a7e0dbfc-7fdb-4483-8ac9-8aecbd00a7af service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received unexpected event network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 for instance with vm_state building and task_state spawning.
Oct 16 07:32:15 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:32:15 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance running successfully.
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Failed to set time: agent not configured {{(pid=74080) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3b909012-1a4b-4bb7-a3fa-b51507f77d01 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] finish_migration finished successfully. {{(pid=74080) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:32:15 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Instance spawned successfully.
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:32:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:16 user nova-compute[74080]: INFO nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Took 6.81 seconds to spawn the instance on the hypervisor.
Oct 16 07:32:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:32:16 user nova-compute[74080]: INFO nova.compute.manager [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Took 7.87 seconds to build instance.
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-573062d5-6cc0-4f2a-a5e6-95337c73f3fe tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "41a5c934-14d2-469f-9fe6-d175ae886673" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.976s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:32:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:19 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:32:19 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7808MB free_disk=25.532333374023438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Applying migration context for instance e4b3aaca-821e-410f-83c1-7287a48c7723 as it has an incoming, in-progress migration 885bd991-2f2e-433a-ba8d-461991be5fed. Migration status is finished {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 07:32:19 user nova-compute[74080]: INFO nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating resource usage from migration 885bd991-2f2e-433a-ba8d-461991be5fed
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f055134f-7d13-4ee6-9dfa-11207791a674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 34cb3aed-3c32-460c-adb1-ab9c176be198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1c601514-628d-4f45-9d06-e8eebc943253 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 04e528d5-491a-4914-a1b2-7eee4efc0caf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 01d16a73-705e-4723-b74c-bc2581f1afb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 87991349-e339-4fcf-b4ef-52936a931511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Migration 885bd991-2f2e-433a-ba8d-461991be5fed is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 41a5c934-14d2-469f-9fe6-d175ae886673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:32:19 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:32:20 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:32:20 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:32:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:32:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:32:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-changed-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing instance network info cache due to event network-changed-be7d6378-4572-41b5-84b0-8fb7a4ea2462. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:32:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] Acquiring lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:32:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] Acquired lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:32:22 user nova-compute[74080]: DEBUG nova.network.neutron [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Refreshing network info cache for port be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:32:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updated VIF entry in instance network info cache for port be7d6378-4572-41b5-84b0-8fb7a4ea2462. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:32:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [{"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-275a5f51-611b-4a02-9607-27b7edbd6251 req-b9e29dda-8654-409e-9530-4720bbbdacfd service nova] Releasing lock "refresh_cache-1c601514-628d-4f45-9d06-e8eebc943253" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "1c601514-628d-4f45-9d06-e8eebc943253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:25 user nova-compute[74080]: INFO nova.compute.manager [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Terminating instance
Oct 16 07:32:25 user nova-compute[74080]: DEBUG nova.compute.manager [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-3d77598a-a561-425d-81c3-0f83f1fe8b27 req-3970464d-46cd-4cd7-8533-e9d9ff72feb8 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3d77598a-a561-425d-81c3-0f83f1fe8b27 req-3970464d-46cd-4cd7-8533-e9d9ff72feb8 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3d77598a-a561-425d-81c3-0f83f1fe8b27 req-3970464d-46cd-4cd7-8533-e9d9ff72feb8 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3d77598a-a561-425d-81c3-0f83f1fe8b27 req-3970464d-46cd-4cd7-8533-e9d9ff72feb8 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-3d77598a-a561-425d-81c3-0f83f1fe8b27 req-3970464d-46cd-4cd7-8533-e9d9ff72feb8 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-unplugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-3d77598a-a561-425d-81c3-0f83f1fe8b27 req-3970464d-46cd-4cd7-8533-e9d9ff72feb8 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ee0991c-e478-4b23-9efc-715615895b07 req-df56a866-34c0-4026-9f47-de71b1000073 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ee0991c-e478-4b23-9efc-715615895b07 req-df56a866-34c0-4026-9f47-de71b1000073 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ee0991c-e478-4b23-9efc-715615895b07 req-df56a866-34c0-4026-9f47-de71b1000073 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ee0991c-e478-4b23-9efc-715615895b07 req-df56a866-34c0-4026-9f47-de71b1000073 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ee0991c-e478-4b23-9efc-715615895b07 req-df56a866-34c0-4026-9f47-de71b1000073 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-unplugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ee0991c-e478-4b23-9efc-715615895b07 req-df56a866-34c0-4026-9f47-de71b1000073 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-194793c2-2ef3-4aca-967e-4ad828705eaa for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-322d0547-cb81-441d-929a-13d5764dea8c req-a13b3453-08ae-4feb-8a53-92057f209f00 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-322d0547-cb81-441d-929a-13d5764dea8c req-a13b3453-08ae-4feb-8a53-92057f209f00 service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-322d0547-cb81-441d-929a-13d5764dea8c req-a13b3453-08ae-4feb-8a53-92057f209f00 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-322d0547-cb81-441d-929a-13d5764dea8c req-a13b3453-08ae-4feb-8a53-92057f209f00 service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-322d0547-cb81-441d-929a-13d5764dea8c req-a13b3453-08ae-4feb-8a53-92057f209f00 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-unplugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-322d0547-cb81-441d-929a-13d5764dea8c req-a13b3453-08ae-4feb-8a53-92057f209f00 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-eda54889-1294-4127-80f4-f2b9e5ac300c for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Instance destroyed successfully.
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.objects.instance [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lazy-loading 'resources' on Instance uuid 1c601514-628d-4f45-9d06-e8eebc943253 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "address": "fa:16:3e:09:4f:ea", "network": {"id": "f2da2576-47cf-481a-a687-922a46299e8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-142853397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7d6378-45", "ovs_interfaceid": "be7d6378-4572-41b5-84b0-8fb7a4ea2462", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=be7d6378-4572-41b5-84b0-8fb7a4ea2462,network=Network(f2da2576-47cf-481a-a687-922a46299e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7d6378-45') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=be7d6378-4572-41b5-84b0-8fb7a4ea2462,network=Network(f2da2576-47cf-481a-a687-922a46299e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7d6378-45') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe7d6378-45, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83ec1e31-ecc7-4a10-b8e3-45d3e4d0f507) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4f:ea,bridge_name='br-int',has_traffic_filtering=True,id=be7d6378-4572-41b5-84b0-8fb7a4ea2462,network=Network(f2da2576-47cf-481a-a687-922a46299e8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7d6378-45')
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:68:91,bridge_name='br-int',has_traffic_filtering=True,id=4320ab8c-b62d-43d5-9bb5-437734f4a2d4,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4320ab8c-b6') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:68:91,bridge_name='br-int',has_traffic_filtering=True,id=4320ab8c-b62d-43d5-9bb5-437734f4a2d4,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4320ab8c-b6') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4320ab8c-b6, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=878416e0-57a3-44ef-b27c-ec475130ed6b) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:68:91,bridge_name='br-int',has_traffic_filtering=True,id=4320ab8c-b62d-43d5-9bb5-437734f4a2d4,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4320ab8c-b6')
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:b5,bridge_name='br-int',has_traffic_filtering=True,id=ee963755-1263-499a-a771-1c77e22cfc29,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee963755-12') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:b5,bridge_name='br-int',has_traffic_filtering=True,id=ee963755-1263-499a-a771-1c77e22cfc29,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee963755-12') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee963755-12, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=baf8aec5-abd9-4adc-9050-31e19eca1cdd) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:17:b5,bridge_name='br-int',has_traffic_filtering=True,id=ee963755-1263-499a-a771-1c77e22cfc29,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee963755-12')
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:52,bridge_name='br-int',has_traffic_filtering=True,id=194793c2-2ef3-4aca-967e-4ad828705eaa,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194793c2-2e') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:52,bridge_name='br-int',has_traffic_filtering=True,id=194793c2-2ef3-4aca-967e-4ad828705eaa,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194793c2-2e') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap194793c2-2e, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2910da20-2ce6-44cb-b166-68be7d2786a1) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:52,bridge_name='br-int',has_traffic_filtering=True,id=194793c2-2ef3-4aca-967e-4ad828705eaa,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap194793c2-2e')
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=ab3d113c-866b-49e3-8948-c70a8f3e9a27,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3d113c-86') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=ab3d113c-866b-49e3-8948-c70a8f3e9a27,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3d113c-86') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab3d113c-86, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f36f421-9e81-481f-b94a-004dbe7a3b78) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b9:98,bridge_name='br-int',has_traffic_filtering=True,id=ab3d113c-866b-49e3-8948-c70a8f3e9a27,network=Network(add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab3d113c-86')
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:0b:55,bridge_name='br-int',has_traffic_filtering=True,id=eda54889-1294-4127-80f4-f2b9e5ac300c,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda54889-12') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:0b:55,bridge_name='br-int',has_traffic_filtering=True,id=eda54889-1294-4127-80f4-f2b9e5ac300c,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda54889-12') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeda54889-12, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27590aff-1af1-48a6-a74a-f6de16e3b2ba) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:0b:55,bridge_name='br-int',has_traffic_filtering=True,id=eda54889-1294-4127-80f4-f2b9e5ac300c,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeda54889-12')
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:29:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2095147051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2095147051',id=8,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeU9q/yoyxC/IBgtLH8lEdVsva37LUIThRoWQVTuKQHR5UMZeRcVyvSf0QFdhkd70TmMT3hAyI3vWOHA5BRYwowI1iPRQBU+b+QANWkjU5aVPIw+7QwEy5obRy/aU4F9Q==',key_name='tempest-keypair-1400047020',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76728d3f4b6f4ddba8a74ac0c4b7179a',ramdisk_id='',reservation_id='r-8b90guxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1639502304',owner_user_name='tempest-TaggedBootDevicesTest_v242-1639502304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1be7ad61fd24c4684ee8243a698254f',uuid=1c601514-628d-4f45-9d06-e8eebc943253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converting VIF {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:62:15,bridge_name='br-int',has_traffic_filtering=True,id=f54431da-f912-4c71-ba33-58340ed9b731,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54431da-f9') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:62:15,bridge_name='br-int',has_traffic_filtering=True,id=f54431da-f912-4c71-ba33-58340ed9b731,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54431da-f9') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf54431da-f9, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa461b79-de01-4e50-b23b-64872b7d4634) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:27 user nova-compute[74080]: INFO os_vif [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:62:15,bridge_name='br-int',has_traffic_filtering=True,id=f54431da-f912-4c71-ba33-58340ed9b731,network=Network(98cb6dec-0081-4a25-92b4-5be1a1753e5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf54431da-f9')
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zKIfacNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:32:27 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f214ca-6bae-4337-b228-169232f8eb48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:32:27 user nova-compute[74080]: No targets found.
Oct 16 07:32:27 user nova-compute[74080]: iSNS:
Oct 16 07:32:27 user nova-compute[74080]: No targets found.
Oct 16 07:32:27 user nova-compute[74080]: STATIC:
Oct 16 07:32:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:32:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb
Oct 16 07:32:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:32:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:32:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:32:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:32:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:27 user nova-compute[74080]: FIRMWARE:
Oct 16 07:32:27 user nova-compute[74080]: No targets found.
Oct 16 07:32:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:32:27 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:32:27 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a274e-3fcb-4763-92a7-173ea5801cd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b0b8ca-c413-4157-895e-b02ee33b706c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:27 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7c412fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb'): ({'sdb'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Removing single pathed devices sdb {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[10952bb5-4dfa-4c3a-ad59-aa8d608d9f53]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baebad9-b571-43ac-aec3-ec0455d06156]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Flushing IO for device /dev/sdb {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:27 user nova-compute[74080]: WARNING nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-be7d6378-4572-41b5-84b0-8fb7a4ea2462 for instance with vm_state active and task_state deleting.
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-unplugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:27 user nova-compute[74080]: WARNING nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-4320ab8c-b62d-43d5-9bb5-437734f4a2d4 for instance with vm_state active and task_state deleting.
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-unplugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-ee963755-1263-499a-a771-1c77e22cfc29 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:27 user nova-compute[74080]: WARNING nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-ee963755-1263-499a-a771-1c77e22cfc29 for instance with vm_state active and task_state deleting.
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-unplugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:27 user nova-compute[74080]: WARNING nova.compute.manager [req-10128e9e-6215-41d1-b6f4-9404bfc1d0f2 req-8625dcfa-55b8-44ae-93f9-a368b2a5c50f service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-ab3d113c-866b-49e3-8948-c70a8f3e9a27 for instance with vm_state active and task_state deleting.
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad5709c-d9b8-4756-9ab6-50f20c96e6e6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[041428ec-2345-4f21-9782-be108e1d7242]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ecb948-76e4-4e10-8870-240758e031c5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fb701e-679b-4757-a05a-cfdc5f1e8612]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260]
Oct 16 07:32:28 user nova-compute[74080]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb, portal: 172.16.0.220,3260] successful.
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-4bf27858-9946-4df0-9e17-fc4eceb75ab5 req-e64f6065-9a47-4854-b19f-4c8d495f702e service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4bf27858-9946-4df0-9e17-fc4eceb75ab5 req-e64f6065-9a47-4854-b19f-4c8d495f702e service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4bf27858-9946-4df0-9e17-fc4eceb75ab5 req-e64f6065-9a47-4854-b19f-4c8d495f702e service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4bf27858-9946-4df0-9e17-fc4eceb75ab5 req-e64f6065-9a47-4854-b19f-4c8d495f702e service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-4bf27858-9946-4df0-9e17-fc4eceb75ab5 req-e64f6065-9a47-4854-b19f-4c8d495f702e service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:28 user nova-compute[74080]: WARNING nova.compute.manager [req-4bf27858-9946-4df0-9e17-fc4eceb75ab5 req-e64f6065-9a47-4854-b19f-4c8d495f702e service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-194793c2-2ef3-4aca-967e-4ad828705eaa for instance with vm_state active and task_state deleting.
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38ce8414-2334-4f99-9396-32111d1658eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.262s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f762d59b-6f96-4e6b-b9ce-7dc2bc4b23d8]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.596s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== disconnect_volume: return (597ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leNDXqFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:32:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[041a87a7-6356-4538-8bd4-f4bf12837b0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:32:28 user nova-compute[74080]: No targets found.
Oct 16 07:32:28 user nova-compute[74080]: iSNS:
Oct 16 07:32:28 user nova-compute[74080]: No targets found.
Oct 16 07:32:28 user nova-compute[74080]: STATIC:
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: FIRMWARE:
Oct 16 07:32:28 user nova-compute[74080]: No targets found.
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:32:28 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:32:28 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:28 user nova-compute[74080]: WARNING nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-eda54889-1294-4127-80f4-f2b9e5ac300c for instance with vm_state active and task_state deleting.
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-unplugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-unplugged-f54431da-f912-4c71-ba33-58340ed9b731 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Acquiring lock "1c601514-628d-4f45-9d06-e8eebc943253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] Lock "1c601514-628d-4f45-9d06-e8eebc943253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] No waiting events found dispatching network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:28 user nova-compute[74080]: WARNING nova.compute.manager [req-e4755b04-6900-4487-9827-f470ddf27de7 req-90e923a0-2625-45b2-b85a-eeecbb65a2ee service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received unexpected event network-vif-plugged-f54431da-f912-4c71-ba33-58340ed9b731 for instance with vm_state active and task_state deleting.
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1481c0a-3745-42d5-b568-8b43d4459fa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8d31ed-4ee0-4e1d-8731-6e16097a6e29]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac41ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6'): ({'sdc'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Removing single pathed devices sdc {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[09648e96-37c4-48ac-a0c4-e79d1ce25564]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ccfbe-f976-4f89-8250-08ecc534a060]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Flushing IO for device /dev/sdc {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0eae66-5cec-4ce7-8b32-75cafdec4657]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef2fc7f-d0b0-459d-9261-aecea0890489]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b851f7-8546-4800-a84d-f6eb3dee8b20]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c49263-918c-4f86-b2a5-cd0a3eeef214]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260]
Oct 16 07:32:28 user nova-compute[74080]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6, portal: 172.16.0.220,3260] successful.
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:152716bd-0c7e-48b2-a6bd-9b15cda007b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3374f682-4f98-49e4-b16e-a0c6b4468816]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== disconnect_volume: return (348ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgWxECqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:32:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e1cb74-68e3-4179-89a8-36fb7f3a043c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:32:28 user nova-compute[74080]: No targets found.
Oct 16 07:32:28 user nova-compute[74080]: iSNS:
Oct 16 07:32:28 user nova-compute[74080]: No targets found.
Oct 16 07:32:28 user nova-compute[74080]: STATIC:
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46
Oct 16 07:32:28 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:32:28 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:32:28 user nova-compute[74080]: FIRMWARE:
Oct 16 07:32:28 user nova-compute[74080]: No targets found.
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:32:28 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:32:28 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0fe4c9-112b-4e55-a57c-a08a0d39f9bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef511b-cc76-4225-964b-166741c44a68]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:32:28 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac41ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46'): ({'sdd'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Removing single pathed devices sdd {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c72db23-6d1f-41bf-9103-22262db8c153]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7a3ea3-5457-4a56-a9d7-656afbd74285]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Flushing IO for device /dev/sdd {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e7098d-c174-4d09-965d-598b78411ced]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[088bdacc-d4cc-465c-a7c2-f3c399d64e56]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd93995-51c1-4886-a434-160ed4f46d6d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dca6ca-2f61-4c4f-b918-a1f4f99cfa22]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260]
Oct 16 07:32:28 user nova-compute[74080]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46, portal: 172.16.0.220,3260] successful.
Oct 16 07:32:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5db36cc-2767-4528-bcc2-8418805c9a46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4ee94a-68cf-420c-ad00-f3826f488fab]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] <== disconnect_volume: return (328ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:32:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:32:28 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Deleting instance files /opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253_del
Oct 16 07:32:28 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Deletion of /opt/stack/data/nova/instances/1c601514-628d-4f45-9d06-e8eebc943253_del complete
Oct 16 07:32:29 user nova-compute[74080]: INFO nova.compute.manager [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Took 3.94 seconds to destroy the instance on the hypervisor.
Oct 16 07:32:29 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:32:29 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:32:29 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-3f4daf2c-b3c6-4e67-87e1-25ff4c3e0963 req-8bb65132-a0eb-4c0f-82b5-23f99330bc27 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-deleted-be7d6378-4572-41b5-84b0-8fb7a4ea2462 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:31 user nova-compute[74080]: INFO nova.compute.manager [req-3f4daf2c-b3c6-4e67-87e1-25ff4c3e0963 req-8bb65132-a0eb-4c0f-82b5-23f99330bc27 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Neutron deleted interface be7d6378-4572-41b5-84b0-8fb7a4ea2462; detaching it from the instance and deleting it from the info cache
Oct 16 07:32:31 user nova-compute[74080]: DEBUG nova.network.neutron [req-3f4daf2c-b3c6-4e67-87e1-25ff4c3e0963 req-8bb65132-a0eb-4c0f-82b5-23f99330bc27 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [{"id": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "address": "fa:16:3e:ce:68:91", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4320ab8c-b6", "ovs_interfaceid": "4320ab8c-b62d-43d5-9bb5-437734f4a2d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee963755-1263-499a-a771-1c77e22cfc29", "address": "fa:16:3e:a8:17:b5", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee963755-12", "ovs_interfaceid": "ee963755-1263-499a-a771-1c77e22cfc29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "194793c2-2ef3-4aca-967e-4ad828705eaa", "address": "fa:16:3e:ce:22:52", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap194793c2-2e", "ovs_interfaceid": "194793c2-2ef3-4aca-967e-4ad828705eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "address": "fa:16:3e:26:b9:98", "network": {"id": "add11cf9-00ef-4cfb-b2f1-0bb2dfd5146d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1275250676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab3d113c-86", "ovs_interfaceid": "ab3d113c-866b-49e3-8948-c70a8f3e9a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eda54889-1294-4127-80f4-f2b9e5ac300c", "address": "fa:16:3e:8a:0b:55", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeda54889-12", "ovs_interfaceid": "eda54889-1294-4127-80f4-f2b9e5ac300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f54431da-f912-4c71-ba33-58340ed9b731", "address": "fa:16:3e:c9:62:15", "network": {"id": "98cb6dec-0081-4a25-92b4-5be1a1753e5b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1951639268", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "76728d3f4b6f4ddba8a74ac0c4b7179a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf54431da-f9", "ovs_interfaceid": "f54431da-f912-4c71-ba33-58340ed9b731", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-3f4daf2c-b3c6-4e67-87e1-25ff4c3e0963 req-8bb65132-a0eb-4c0f-82b5-23f99330bc27 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Detach interface failed, port_id=be7d6378-4572-41b5-84b0-8fb7a4ea2462, reason: Instance 1c601514-628d-4f45-9d06-e8eebc943253 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:31 user nova-compute[74080]: INFO nova.compute.manager [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Terminating instance
Oct 16 07:32:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-039e44f2-3fe4-40b6-a8ab-d174151dd34e req-402610bd-3076-4f5c-b6fd-b16da0f3c36d service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-unplugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-039e44f2-3fe4-40b6-a8ab-d174151dd34e req-402610bd-3076-4f5c-b6fd-b16da0f3c36d service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-039e44f2-3fe4-40b6-a8ab-d174151dd34e req-402610bd-3076-4f5c-b6fd-b16da0f3c36d service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-039e44f2-3fe4-40b6-a8ab-d174151dd34e req-402610bd-3076-4f5c-b6fd-b16da0f3c36d service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-039e44f2-3fe4-40b6-a8ab-d174151dd34e req-402610bd-3076-4f5c-b6fd-b16da0f3c36d service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-unplugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-039e44f2-3fe4-40b6-a8ab-d174151dd34e req-402610bd-3076-4f5c-b6fd-b16da0f3c36d service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-unplugged-7d924de9-0e44-4edf-992f-d94e6d91a876 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Instance destroyed successfully.
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.objects.instance [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lazy-loading 'resources' on Instance uuid 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:28:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-536006916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-536006916',id=5,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrRLMlWzRM3ASEifS3cZ+3xZmFfWXW0w0YVYoP94u8kxV5oCGvzv/VQK4gam/dbywdCx7d06aCtr/M1eOAGOvL/9MMggVazmHc33+U4I7pZr1sT3VAo5mJ/og2jhD/PTw==',key_name='tempest-keypair-1743459203',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c006491b0f449394c55b7024a19bb6',ramdisk_id='',reservation_id='r-lczrel0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1912564389',owner_user_name='tempest-TaggedAttachmentsTest-1912564389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b60dc9148587426ebd0b15ddb70a3139',uuid=3dc7ff51-67ae-4d38-bf1f-e28483e40d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converting VIF {"id": "7d924de9-0e44-4edf-992f-d94e6d91a876", "address": "fa:16:3e:2f:6f:2b", "network": {"id": "3a953741-ae48-4e82-8ca9-aaac122ad027", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-304822254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c006491b0f449394c55b7024a19bb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d924de9-0e", "ovs_interfaceid": "7d924de9-0e44-4edf-992f-d94e6d91a876", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6f:2b,bridge_name='br-int',has_traffic_filtering=True,id=7d924de9-0e44-4edf-992f-d94e6d91a876,network=Network(3a953741-ae48-4e82-8ca9-aaac122ad027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d924de9-0e') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG os_vif [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6f:2b,bridge_name='br-int',has_traffic_filtering=True,id=7d924de9-0e44-4edf-992f-d94e6d91a876,network=Network(3a953741-ae48-4e82-8ca9-aaac122ad027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d924de9-0e') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d924de9-0e, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=689f2ee7-1a16-47a2-b85f-2172a56ecaaa) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:32 user nova-compute[74080]: INFO os_vif [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6f:2b,bridge_name='br-int',has_traffic_filtering=True,id=7d924de9-0e44-4edf-992f-d94e6d91a876,network=Network(3a953741-ae48-4e82-8ca9-aaac122ad027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d924de9-0e')
Oct 16 07:32:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Deleting instance files /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b_del
Oct 16 07:32:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Deletion of /opt/stack/data/nova/instances/3dc7ff51-67ae-4d38-bf1f-e28483e40d5b_del complete
Oct 16 07:32:32 user nova-compute[74080]: INFO nova.compute.manager [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 16 07:32:32 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:32:32 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:32 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Took 3.67 seconds to deallocate network for instance.
Oct 16 07:32:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-07c7272d-1337-429d-bc50-dbb68d3e5403 req-2ece73af-f131-4c4a-88a7-ad4951970be8 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-deleted-194793c2-2ef3-4aca-967e-4ad828705eaa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-07c7272d-1337-429d-bc50-dbb68d3e5403 req-2ece73af-f131-4c4a-88a7-ad4951970be8 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-deleted-ab3d113c-866b-49e3-8948-c70a8f3e9a27 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-07c7272d-1337-429d-bc50-dbb68d3e5403 req-2ece73af-f131-4c4a-88a7-ad4951970be8 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-deleted-f54431da-f912-4c71-ba33-58340ed9b731 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-07c7272d-1337-429d-bc50-dbb68d3e5403 req-2ece73af-f131-4c4a-88a7-ad4951970be8 service nova] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Received event network-vif-deleted-eda54889-1294-4127-80f4-f2b9e5ac300c {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] Acquiring lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] No waiting events found dispatching network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:34 user nova-compute[74080]: WARNING nova.compute.manager [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received unexpected event network-vif-plugged-7d924de9-0e44-4edf-992f-d94e6d91a876 for instance with vm_state active and task_state deleting.
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-changed-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Refreshing instance network info cache due to event network-changed-095a5de1-67c7-45aa-82eb-3f62a5bccdd0. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] Acquiring lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] Acquired lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Refreshing network info cache for port 095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:34 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Took 1.49 seconds to deallocate network for instance.
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "01d16a73-705e-4723-b74c-bc2581f1afb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:34 user nova-compute[74080]: INFO nova.compute.manager [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Terminating instance
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.compute.manager [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Updated VIF entry in instance network info cache for port 095a5de1-67c7-45aa-82eb-3f62a5bccdd0. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Updating instance_info_cache with network_info: [{"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80bb96cf-16d3-4aa7-9c22-91dfd3f3047c req-7f121786-3953-4e0a-898e-06520398adf3 service nova] Releasing lock "refresh_cache-01d16a73-705e-4723-b74c-bc2581f1afb7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:32:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:35 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Deleted allocations for instance 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3a0f6ee7-7bf9-45dc-b029-412095ad4115 tempest-TaggedAttachmentsTest-1912564389 tempest-TaggedAttachmentsTest-1912564389-project-member] Lock "3dc7ff51-67ae-4d38-bf1f-e28483e40d5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.359s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-0d4c5d6a-4231-4bb3-a781-32d23b2c330f req-84c34e07-d430-4d09-b369-33bca54009b5 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-vif-unplugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d4c5d6a-4231-4bb3-a781-32d23b2c330f req-84c34e07-d430-4d09-b369-33bca54009b5 service nova] Acquiring lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d4c5d6a-4231-4bb3-a781-32d23b2c330f req-84c34e07-d430-4d09-b369-33bca54009b5 service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d4c5d6a-4231-4bb3-a781-32d23b2c330f req-84c34e07-d430-4d09-b369-33bca54009b5 service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-0d4c5d6a-4231-4bb3-a781-32d23b2c330f req-84c34e07-d430-4d09-b369-33bca54009b5 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] No waiting events found dispatching network-vif-unplugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-0d4c5d6a-4231-4bb3-a781-32d23b2c330f req-84c34e07-d430-4d09-b369-33bca54009b5 service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-vif-unplugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Instance destroyed successfully.
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'resources' on Instance uuid 01d16a73-705e-4723-b74c-bc2581f1afb7 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1387690353',display_name='tempest-AttachVolumeNegativeTest-server-1387690353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1387690353',id=10,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz5XYWtr4Lk/kYbebbuCJ/HNy17bCQ0Yjs+WILyFF+PR9U3eymjmg1WY5xT5dom6xOMRrwMSeDrCC3aTY0xyLsswUjw425BTwP2vj+Hi6m0S/XqEJdLpJ3c3fdrJdHGbw==',key_name='tempest-keypair-1318532778',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-pif9apqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:30:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=01d16a73-705e-4723-b74c-bc2581f1afb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "address": "fa:16:3e:58:d0:8c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap095a5de1-67", "ovs_interfaceid": "095a5de1-67c7-45aa-82eb-3f62a5bccdd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d0:8c,bridge_name='br-int',has_traffic_filtering=True,id=095a5de1-67c7-45aa-82eb-3f62a5bccdd0,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095a5de1-67') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG os_vif [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d0:8c,bridge_name='br-int',has_traffic_filtering=True,id=095a5de1-67c7-45aa-82eb-3f62a5bccdd0,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095a5de1-67') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap095a5de1-67, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1d2da31-4f52-47e9-80f0-d138c5e57fdd) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:35 user nova-compute[74080]: INFO os_vif [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d0:8c,bridge_name='br-int',has_traffic_filtering=True,id=095a5de1-67c7-45aa-82eb-3f62a5bccdd0,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap095a5de1-67')
Oct 16 07:32:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Deleting instance files /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7_del
Oct 16 07:32:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Deletion of /opt/stack/data/nova/instances/01d16a73-705e-4723-b74c-bc2581f1afb7_del complete
Oct 16 07:32:35 user nova-compute[74080]: INFO nova.compute.manager [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Took 0.68 seconds to destroy the instance on the hypervisor.
Oct 16 07:32:35 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-5ee497b8-48d6-4cf9-aecc-2e56b5fc09ec req-1aeb620b-1674-4151-a0c2-cf5492397a50 service nova] [instance: 3dc7ff51-67ae-4d38-bf1f-e28483e40d5b] Received event network-vif-deleted-7d924de9-0e44-4edf-992f-d94e6d91a876 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:35 user nova-compute[74080]: INFO nova.compute.manager [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] [instance: 1c601514-628d-4f45-9d06-e8eebc943253] Took 2.76 seconds to detach 3 volumes for instance.
Oct 16 07:32:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:36 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Deleted allocations for instance 1c601514-628d-4f45-9d06-e8eebc943253
Oct 16 07:32:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-39a82728-3336-463f-aa21-0b6a946c4f99 tempest-TaggedBootDevicesTest_v242-1639502304 tempest-TaggedBootDevicesTest_v242-1639502304-project-member] Lock "1c601514-628d-4f45-9d06-e8eebc943253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.023s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:36 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Took 0.87 seconds to deallocate network for instance.
Oct 16 07:32:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:32:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:36 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Deleted allocations for instance 01d16a73-705e-4723-b74c-bc2581f1afb7
Oct 16 07:32:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7a22f657-deb1-4940-a0a7-a1dea2751a79 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-40504b39-e4bc-49a8-aa5f-29d7037c490f req-6632f4fd-c658-4592-aecd-5cfe43b8fffb service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-40504b39-e4bc-49a8-aa5f-29d7037c490f req-6632f4fd-c658-4592-aecd-5cfe43b8fffb service nova] Acquiring lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-40504b39-e4bc-49a8-aa5f-29d7037c490f req-6632f4fd-c658-4592-aecd-5cfe43b8fffb service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-40504b39-e4bc-49a8-aa5f-29d7037c490f req-6632f4fd-c658-4592-aecd-5cfe43b8fffb service nova] Lock "01d16a73-705e-4723-b74c-bc2581f1afb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-40504b39-e4bc-49a8-aa5f-29d7037c490f req-6632f4fd-c658-4592-aecd-5cfe43b8fffb service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] No waiting events found dispatching network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:37 user nova-compute[74080]: WARNING nova.compute.manager [req-40504b39-e4bc-49a8-aa5f-29d7037c490f req-6632f4fd-c658-4592-aecd-5cfe43b8fffb service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received unexpected event network-vif-plugged-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 for instance with vm_state deleted and task_state None.
Oct 16 07:32:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-5466e66c-4989-4de7-bc4b-dd179b7b8c2f req-8d3a00f1-c199-4d77-9ada-aa75bfdcbeca service nova] [instance: 01d16a73-705e-4723-b74c-bc2581f1afb7] Received event network-vif-deleted-095a5de1-67c7-45aa-82eb-3f62a5bccdd0 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:40 user nova-compute[74080]: INFO nova.compute.manager [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Terminating instance
Oct 16 07:32:40 user nova-compute[74080]: DEBUG nova.compute.manager [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-188da785-fba7-4324-86f9-be24254fead7 req-493196c6-3d14-4bdf-b5bc-74a46f74b3a1 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-vif-unplugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-188da785-fba7-4324-86f9-be24254fead7 req-493196c6-3d14-4bdf-b5bc-74a46f74b3a1 service nova] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-188da785-fba7-4324-86f9-be24254fead7 req-493196c6-3d14-4bdf-b5bc-74a46f74b3a1 service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-188da785-fba7-4324-86f9-be24254fead7 req-493196c6-3d14-4bdf-b5bc-74a46f74b3a1 service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-188da785-fba7-4324-86f9-be24254fead7 req-493196c6-3d14-4bdf-b5bc-74a46f74b3a1 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] No waiting events found dispatching network-vif-unplugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-188da785-fba7-4324-86f9-be24254fead7 req-493196c6-3d14-4bdf-b5bc-74a46f74b3a1 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-vif-unplugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:32:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Instance destroyed successfully.
Oct 16 07:32:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lazy-loading 'resources' on Instance uuid 34cb3aed-3c32-460c-adb1-ab9c176be198 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-273747852',display_name='tempest-VolumesAssistedSnapshotsTest-server-273747852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-273747852',id=7,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3vtAFGT5mUtCrp4xBl0njKC2wgUrJGix8k3c5PHOV88ZEdx/nZQ7TJvfWqAHlYriaTMOdpJkycrBjadKGkwm+PeiIHTiroO85HOBpIxBLaW13wT61U3jxd7qILfw7Wpg==',key_name='tempest-keypair-191544254',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:29:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9da26bd07344cf784949d00a631aa1d',ramdisk_id='',reservation_id='r-w88jebdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1847366625',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1847366625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a49123cad7b423186a3dcf52ffbf758',uuid=34cb3aed-3c32-460c-adb1-ab9c176be198,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Converting VIF {"id": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "address": "fa:16:3e:61:f7:c8", "network": {"id": "fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-529320248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9da26bd07344cf784949d00a631aa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd98fac77-a3", "ovs_interfaceid": "d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:f7:c8,bridge_name='br-int',has_traffic_filtering=True,id=d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2,network=Network(fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98fac77-a3') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG os_vif [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:f7:c8,bridge_name='br-int',has_traffic_filtering=True,id=d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2,network=Network(fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98fac77-a3') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd98fac77-a3, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=408ed83d-e5d0-4ccf-b677-79db0d7b4f33) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:41 user nova-compute[74080]: INFO os_vif [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:f7:c8,bridge_name='br-int',has_traffic_filtering=True,id=d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2,network=Network(fdc5beb1-47b0-4cec-8b24-b0759f0ef6f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd98fac77-a3')
Oct 16 07:32:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Deleting instance files /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198_del
Oct 16 07:32:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Deletion of /opt/stack/data/nova/instances/34cb3aed-3c32-460c-adb1-ab9c176be198_del complete
Oct 16 07:32:41 user nova-compute[74080]: INFO nova.compute.manager [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 16 07:32:41 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:32:41 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:32:42 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Took 0.88 seconds to deallocate network for instance.
Oct 16 07:32:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-884ef95e-b003-4c06-b8af-6e05a668ab35 req-223f3588-8082-45f0-87b7-5727ad32f96b service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-vif-deleted-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:42 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Deleted allocations for instance 34cb3aed-3c32-460c-adb1-ab9c176be198
Oct 16 07:32:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-24c4c13d-99d5-4fca-986f-8615367e0843 tempest-VolumesAssistedSnapshotsTest-1847366625 tempest-VolumesAssistedSnapshotsTest-1847366625-project-member] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-553ba407-5ff8-4c15-a3a6-47781a7c2130 req-efcb0110-4dfc-46da-b7c5-b3b8c261bdb0 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received event network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-553ba407-5ff8-4c15-a3a6-47781a7c2130 req-efcb0110-4dfc-46da-b7c5-b3b8c261bdb0 service nova] Acquiring lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-553ba407-5ff8-4c15-a3a6-47781a7c2130 req-efcb0110-4dfc-46da-b7c5-b3b8c261bdb0 service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-553ba407-5ff8-4c15-a3a6-47781a7c2130 req-efcb0110-4dfc-46da-b7c5-b3b8c261bdb0 service nova] Lock "34cb3aed-3c32-460c-adb1-ab9c176be198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:32:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-553ba407-5ff8-4c15-a3a6-47781a7c2130 req-efcb0110-4dfc-46da-b7c5-b3b8c261bdb0 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] No waiting events found dispatching network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:32:42 user nova-compute[74080]: WARNING nova.compute.manager [req-553ba407-5ff8-4c15-a3a6-47781a7c2130 req-efcb0110-4dfc-46da-b7c5-b3b8c261bdb0 service nova] [instance: 34cb3aed-3c32-460c-adb1-ab9c176be198] Received unexpected event network-vif-plugged-d98fac77-a33c-46cf-b7bd-fb7d1fc7a9e2 for instance with vm_state deleted and task_state None.
Oct 16 07:32:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:32:57 user nova-compute[74080]: INFO nova.virt.block_device [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Booting with volume 1bf17329-c5af-40ad-b992-8912de4e6123 at /dev/vdc
Oct 16 07:32:57 user nova-compute[74080]: DEBUG os_brick.utils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a3331-d1b4-4918-8e90-333e3ff6c437]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7903dc0-0253-402a-a86a-1751b23af691]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[584ee52a-8161-4a91-9340-e31385a3a606]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a9b83-a636-489c-aef3-09a2ec4332ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:32:57 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:32:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2df05-09ac-4586-a66e-17c279739cea]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG os_brick.utils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:32:57 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating existing volume attachment record: ddcc9698-5892-4cc3-93cf-4bd57ebd48c0 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:32:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:02 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:33:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:33:02 user nova-compute[74080]: INFO nova.compute.claims [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Claim successful on node user
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:33:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.policy [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e555075cd0d49f9af33eb6ebfe8d55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c87d6996a3e46d19f45367113c987c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:33:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Creating image(s)
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.228s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk 1073741824" returned: 0 in 0.058s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Cannot resize image /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Ensure instance console log exists: /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:04 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Successfully created port: 8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Successfully updated port: 8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquired lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-changed-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Refreshing instance network info cache due to event network-changed-8fb90376-ac0a-4d74-8a23-29564ea728a4. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] Acquiring lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Releasing lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance network_info: |[{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] Acquired lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.neutron [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Refreshing network info cache for port 8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Start _get_guest_xml network_info=[{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:33:05 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:33:05 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:33:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'pci_devices' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:33:05 user nova-compute[74080]:   <uuid>a889e1ab-9c69-4dbb-8a67-79d24bd67678</uuid>
Oct 16 07:33:05 user nova-compute[74080]:   <name>instance-0000000d</name>
Oct 16 07:33:05 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:33:05 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:33:05 user nova-compute[74080]:   <metadata>
Oct 16 07:33:05 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:33:05 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:33:05 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeTestJSON-server-878526387</nova:name>
Oct 16 07:33:05 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:33:05</nova:creationTime>
Oct 16 07:33:05 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:33:05 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:33:05 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:33:05 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:33:05 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:33:05 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:33:05 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:33:05 user nova-compute[74080]:       <nova:owner>
Oct 16 07:33:05 user nova-compute[74080]:         <nova:user uuid="3e555075cd0d49f9af33eb6ebfe8d55a">tempest-AttachVolumeTestJSON-1619996160-project-member</nova:user>
Oct 16 07:33:05 user nova-compute[74080]:         <nova:project uuid="7c87d6996a3e46d19f45367113c987c9">tempest-AttachVolumeTestJSON-1619996160</nova:project>
Oct 16 07:33:05 user nova-compute[74080]:       </nova:owner>
Oct 16 07:33:05 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:33:05 user nova-compute[74080]:       <nova:ports>
Oct 16 07:33:05 user nova-compute[74080]:         <nova:port uuid="8fb90376-ac0a-4d74-8a23-29564ea728a4">
Oct 16 07:33:05 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:33:05 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:05 user nova-compute[74080]:       </nova:ports>
Oct 16 07:33:05 user nova-compute[74080]:     </nova:instance>
Oct 16 07:33:05 user nova-compute[74080]:   </metadata>
Oct 16 07:33:05 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:33:05 user nova-compute[74080]:     <system>
Oct 16 07:33:05 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:33:05 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:33:05 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:33:05 user nova-compute[74080]:       <entry name="serial">a889e1ab-9c69-4dbb-8a67-79d24bd67678</entry>
Oct 16 07:33:05 user nova-compute[74080]:       <entry name="uuid">a889e1ab-9c69-4dbb-8a67-79d24bd67678</entry>
Oct 16 07:33:05 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:33:05 user nova-compute[74080]:     </system>
Oct 16 07:33:05 user nova-compute[74080]:   </sysinfo>
Oct 16 07:33:05 user nova-compute[74080]:   <os>
Oct 16 07:33:05 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:33:05 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:33:05 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:33:05 user nova-compute[74080]:   </os>
Oct 16 07:33:05 user nova-compute[74080]:   <features>
Oct 16 07:33:05 user nova-compute[74080]:     <acpi/>
Oct 16 07:33:05 user nova-compute[74080]:     <apic/>
Oct 16 07:33:05 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:33:05 user nova-compute[74080]:   </features>
Oct 16 07:33:05 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:33:05 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:33:05 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:33:05 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:33:05 user nova-compute[74080]:   </clock>
Oct 16 07:33:05 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:33:05 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:33:05 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:33:05 user nova-compute[74080]:   </cpu>
Oct 16 07:33:05 user nova-compute[74080]:   <devices>
Oct 16 07:33:05 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:33:05 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:33:05 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk"/>
Oct 16 07:33:05 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:33:05 user nova-compute[74080]:     </disk>
Oct 16 07:33:05 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:05 user nova-compute[74080]:       <mac address="fa:16:3e:e0:3e:55"/>
Oct 16 07:33:05 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:05 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:05 user nova-compute[74080]:       <target dev="tap8fb90376-ac"/>
Oct 16 07:33:05 user nova-compute[74080]:     </interface>
Oct 16 07:33:05 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:33:05 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/console.log" append="off"/>
Oct 16 07:33:05 user nova-compute[74080]:     </serial>
Oct 16 07:33:05 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:33:05 user nova-compute[74080]:     <video>
Oct 16 07:33:05 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:05 user nova-compute[74080]:     </video>
Oct 16 07:33:05 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:33:05 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:33:05 user nova-compute[74080]:     </rng>
Oct 16 07:33:05 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:33:05 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:33:05 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:33:05 user nova-compute[74080]:     </memballoon>
Oct 16 07:33:05 user nova-compute[74080]:   </devices>
Oct 16 07:33:05 user nova-compute[74080]: </domain>
Oct 16 07:33:05 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:33:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG os_vif [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50b2ca38-57a2-507b-8601-44fb2772180c', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fb90376-ac, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fb90376-ac, col_values=(('qos', UUID('9146e242-93d2-4ee2-ad23-806e35c0f4fd')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fb90376-ac, col_values=(('external_ids', {'iface-id': '8fb90376-ac0a-4d74-8a23-29564ea728a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:3e:55', 'vm-uuid': 'a889e1ab-9c69-4dbb-8a67-79d24bd67678'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:05 user nova-compute[74080]: INFO os_vif [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac')
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No VIF found with MAC fa:16:3e:e0:3e:55, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.neutron [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updated VIF entry in instance network info cache for port 8fb90376-ac0a-4d74-8a23-29564ea728a4. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG nova.network.neutron [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1dd6f54e-bed9-42a1-8867-1d7c78f905ae req-c47b57d1-ec16-4201-baca-9184a9457dad service nova] Releasing lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:33:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-4ad1575f-7a9b-4a5d-8c94-fd6d22267bb9 req-442b9e54-130b-4669-b64b-633d7dc59bbd service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4ad1575f-7a9b-4a5d-8c94-fd6d22267bb9 req-442b9e54-130b-4669-b64b-633d7dc59bbd service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4ad1575f-7a9b-4a5d-8c94-fd6d22267bb9 req-442b9e54-130b-4669-b64b-633d7dc59bbd service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4ad1575f-7a9b-4a5d-8c94-fd6d22267bb9 req-442b9e54-130b-4669-b64b-633d7dc59bbd service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-4ad1575f-7a9b-4a5d-8c94-fd6d22267bb9 req-442b9e54-130b-4669-b64b-633d7dc59bbd service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:07 user nova-compute[74080]: WARNING nova.compute.manager [req-4ad1575f-7a9b-4a5d-8c94-fd6d22267bb9 req-442b9e54-130b-4669-b64b-633d7dc59bbd service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state building and task_state spawning.
Oct 16 07:33:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:33:09 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance spawned successfully.
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:09 user nova-compute[74080]: INFO nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Took 5.94 seconds to spawn the instance on the hypervisor.
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:33:09 user nova-compute[74080]: INFO nova.compute.manager [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Took 6.74 seconds to build instance.
Oct 16 07:33:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fcabbd83-3a51-48b0-990e-09bbacf97a89 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.935s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-56360173-d11a-4a5b-bde2-0b284007c015 req-ea9b7368-941b-4e29-96b0-8ac74c488476 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-56360173-d11a-4a5b-bde2-0b284007c015 req-ea9b7368-941b-4e29-96b0-8ac74c488476 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-56360173-d11a-4a5b-bde2-0b284007c015 req-ea9b7368-941b-4e29-96b0-8ac74c488476 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-56360173-d11a-4a5b-bde2-0b284007c015 req-ea9b7368-941b-4e29-96b0-8ac74c488476 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-56360173-d11a-4a5b-bde2-0b284007c015 req-ea9b7368-941b-4e29-96b0-8ac74c488476 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:09 user nova-compute[74080]: WARNING nova.compute.manager [req-56360173-d11a-4a5b-bde2-0b284007c015 req-ea9b7368-941b-4e29-96b0-8ac74c488476 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state active and task_state None.
Oct 16 07:33:10 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "04e528d5-491a-4914-a1b2-7eee4efc0caf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:12 user nova-compute[74080]: INFO nova.compute.manager [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Terminating instance
Oct 16 07:33:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-e9480bf7-e951-42b4-9701-c507c0e4f212 req-713b20a8-b68d-4f74-918d-fdfeeba9ce2f service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received event network-vif-unplugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9480bf7-e951-42b4-9701-c507c0e4f212 req-713b20a8-b68d-4f74-918d-fdfeeba9ce2f service nova] Acquiring lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9480bf7-e951-42b4-9701-c507c0e4f212 req-713b20a8-b68d-4f74-918d-fdfeeba9ce2f service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9480bf7-e951-42b4-9701-c507c0e4f212 req-713b20a8-b68d-4f74-918d-fdfeeba9ce2f service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-e9480bf7-e951-42b4-9701-c507c0e4f212 req-713b20a8-b68d-4f74-918d-fdfeeba9ce2f service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] No waiting events found dispatching network-vif-unplugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-e9480bf7-e951-42b4-9701-c507c0e4f212 req-713b20a8-b68d-4f74-918d-fdfeeba9ce2f service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received event network-vif-unplugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:33:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Instance destroyed successfully.
Oct 16 07:33:12 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'resources' on Instance uuid 04e528d5-491a-4914-a1b2-7eee4efc0caf {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-521487713',display_name='tempest-TestVolumeBootPattern-server-521487713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-521487713',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:31:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-8kcmg9xl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:31:23Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=04e528d5-491a-4914-a1b2-7eee4efc0caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "address": "fa:16:3e:dd:92:06", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb381aba5-0d", "ovs_interfaceid": "b381aba5-0dfe-4d9d-85d3-32f84e65bc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:92:06,bridge_name='br-int',has_traffic_filtering=True,id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381aba5-0d') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_vif [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:92:06,bridge_name='br-int',has_traffic_filtering=True,id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381aba5-0d') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb381aba5-0d, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b03685a-8cb6-4e05-88fa-0d55ef728ca3) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:13 user nova-compute[74080]: INFO os_vif [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:92:06,bridge_name='br-int',has_traffic_filtering=True,id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb381aba5-0d')
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VSBtRgkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:13 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f484c-8d4b-459a-b9ae-0ce129b6d27b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:33:13 user nova-compute[74080]: No targets found.
Oct 16 07:33:13 user nova-compute[74080]: iSNS:
Oct 16 07:33:13 user nova-compute[74080]: No targets found.
Oct 16 07:33:13 user nova-compute[74080]: STATIC:
Oct 16 07:33:13 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:33:13 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:13 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:13 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:33:13 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:13 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:13 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab
Oct 16 07:33:13 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:13 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:13 user nova-compute[74080]: FIRMWARE:
Oct 16 07:33:13 user nova-compute[74080]: No targets found.
Oct 16 07:33:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:33:13 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:33:13 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b4060e-7b1d-4302-a7fc-487d7a7f7cf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3255d610-f3bf-4994-bffb-4f5d87d1cb82]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:13 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:13 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:33:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:13 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:13 user nova-compute[74080]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab (non-flash)
Oct 16 07:33:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac37d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab'): ({'sdi'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Removing single pathed devices sdi {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b657c1-e7ae-4e30-95be-5ac5dc210069]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb01be73-4ec8-4890-a2c9-cf62fff84c84]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flushing IO for device /dev/sdi {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9760b7-c907-460e-8b24-209143e58f2f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb4cde-d3c4-42f7-9025-b0a926068e5a]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] SCSI volumes sdi have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26230333334643133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8984163e', '/dev/disk/by-id/scsi-1SCST_BIO8984163e-b0334d13030bed13') {{(pid=85089) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1252b0b6-8772-4ecf-9e27-907908ed3672]: (4, None) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2a70bc-79f2-41d0-8408-ca697b470fb9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[448bc686-e8d7-43fe-9635-478cfb65ff59]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260]
Oct 16 07:33:13 user nova-compute[74080]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab, portal: 172.16.0.220,3260] successful.
Oct 16 07:33:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04f4792b-47f0-4f4e-a60d-70ae11e957ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[46579caf-4783-4634-aea5-f0ac8b7a1a29]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== disconnect_volume: return (380ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:33:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Deleting instance files /opt/stack/data/nova/instances/04e528d5-491a-4914-a1b2-7eee4efc0caf_del
Oct 16 07:33:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Deletion of /opt/stack/data/nova/instances/04e528d5-491a-4914-a1b2-7eee4efc0caf_del complete
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Didn't find any instances for network info cache update. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 07:33:13 user nova-compute[74080]: INFO nova.compute.manager [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 16 07:33:13 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:33:13 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:14 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Took 0.59 seconds to deallocate network for instance.
Oct 16 07:33:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-46d056e1-7242-4538-a408-207397fa44cb req-2277bd58-d4da-47aa-8cda-317398b23eca service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received event network-vif-deleted-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:14 user nova-compute[74080]: INFO nova.compute.manager [req-46d056e1-7242-4538-a408-207397fa44cb req-2277bd58-d4da-47aa-8cda-317398b23eca service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Neutron deleted interface b381aba5-0dfe-4d9d-85d3-32f84e65bc78; detaching it from the instance and deleting it from the info cache
Oct 16 07:33:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-46d056e1-7242-4538-a408-207397fa44cb req-2277bd58-d4da-47aa-8cda-317398b23eca service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-46d056e1-7242-4538-a408-207397fa44cb req-2277bd58-d4da-47aa-8cda-317398b23eca service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Detach interface failed, port_id=b381aba5-0dfe-4d9d-85d3-32f84e65bc78, reason: Instance 04e528d5-491a-4914-a1b2-7eee4efc0caf could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-74d66b83-5dac-47c5-b17b-322f1c1a887f req-80c14c36-c276-4786-aaf7-609f95dcc597 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received event network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-74d66b83-5dac-47c5-b17b-322f1c1a887f req-80c14c36-c276-4786-aaf7-609f95dcc597 service nova] Acquiring lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-74d66b83-5dac-47c5-b17b-322f1c1a887f req-80c14c36-c276-4786-aaf7-609f95dcc597 service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-74d66b83-5dac-47c5-b17b-322f1c1a887f req-80c14c36-c276-4786-aaf7-609f95dcc597 service nova] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-74d66b83-5dac-47c5-b17b-322f1c1a887f req-80c14c36-c276-4786-aaf7-609f95dcc597 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] No waiting events found dispatching network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:14 user nova-compute[74080]: WARNING nova.compute.manager [req-74d66b83-5dac-47c5-b17b-322f1c1a887f req-80c14c36-c276-4786-aaf7-609f95dcc597 service nova] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Received unexpected event network-vif-plugged-b381aba5-0dfe-4d9d-85d3-32f84e65bc78 for instance with vm_state active and task_state deleting.
Oct 16 07:33:14 user nova-compute[74080]: INFO nova.compute.manager [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Took 0.87 seconds to detach 1 volumes for instance.
Oct 16 07:33:15 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 04e528d5-491a-4914-a1b2-7eee4efc0caf] Deleting volume: 04f4792b-47f0-4f4e-a60d-70ae11e957ab {{(pid=74080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 07:33:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:15 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:15 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:33:15 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:33:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:15 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Deleted allocations for instance 04e528d5-491a-4914-a1b2-7eee4efc0caf
Oct 16 07:33:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b880114d-b5ea-4146-8eac-8e84a17b67db tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "04e528d5-491a-4914-a1b2-7eee4efc0caf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.471s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:20 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:33:20 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=8117MB free_disk=25.61310577392578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Applying migration context for instance e4b3aaca-821e-410f-83c1-7287a48c7723 as it has an incoming, in-progress migration 885bd991-2f2e-433a-ba8d-461991be5fed. Migration status is finished {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 07:33:20 user nova-compute[74080]: INFO nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating resource usage from migration 885bd991-2f2e-433a-ba8d-461991be5fed
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f055134f-7d13-4ee6-9dfa-11207791a674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 87991349-e339-4fcf-b4ef-52936a931511 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Migration 885bd991-2f2e-433a-ba8d-461991be5fed is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 41a5c934-14d2-469f-9fe6-d175ae886673 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:33:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:33:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:26 user nova-compute[74080]: INFO nova.compute.manager [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Detaching volume 3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:33:26 user nova-compute[74080]: INFO nova.virt.block_device [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Attempting to driver detach volume 3e7ac34b-c1b3-444b-8216-b2ef2babecba from mountpoint /dev/vdb
Oct 16 07:33:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Attempting to detach device vdb from instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:33:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:33:26 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:33:26 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:33:26 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:33:26 user nova-compute[74080]:   <serial>3e7ac34b-c1b3-444b-8216-b2ef2babecba</serial>
Oct 16 07:33:26 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:33:26 user nova-compute[74080]: </disk>
Oct 16 07:33:26 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:33:26 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully detached device vdb from instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 from the persistent domain config.
Oct 16 07:33:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:33:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:33:26 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:33:26 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:33:26 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:33:26 user nova-compute[74080]:   <serial>3e7ac34b-c1b3-444b-8216-b2ef2babecba</serial>
Oct 16 07:33:26 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:33:26 user nova-compute[74080]: </disk>
Oct 16 07:33:26 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:33:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:33:27 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Creating image(s)
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Ensure instance console log exists: /opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Start _get_guest_xml network_info=[{"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '8070d657-e2b7-4115-b4c0-ba85859696af', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbnAetcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87991349-e339-4fcf-b4ef-52936a931511', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef9e8398-a4e0-4fea-b500-4e4344ef77e3', 'serial': 'ef9e8398-a4e0-4fea-b500-4e4344ef77e3'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '264496cf-da70-4f16-a431-151611ce94f4', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPOZSCJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87991349-e339-4fcf-b4ef-52936a931511', 'attached_at': '', 'detached_at': '', 'volume_id': '2faf61ec-a1c7-445c-a7de-aefab2c773a4', 'serial': '2faf61ec-a1c7-445c-a7de-aefab2c773a4'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'ddcc9698-5892-4cc3-93cf-4bd57ebd48c0', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZHtpxnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87991349-e339-4fcf-b4ef-52936a931511', 'attached_at': '', 'detached_at': '', 'volume_id': '1bf17329-c5af-40ad-b992-8912de4e6123', 'serial': '1bf17329-c5af-40ad-b992-8912de4e6123'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:33:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:33:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbnAetcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:27 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:27 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:27 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16576737-cb06-4885-9329-ef13977d9e5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:33:27 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0c318f-5d45-4563-827a-80d645d336f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3] added
Oct 16 07:33:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5465614f-6c7a-4e61-88d9-0a2261001f16]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd777b2-92fb-4d6f-bae9-ce383ab69cd9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbnAetcC {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbnAetcC" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3814e48-48cf-4080-8371-4330b2114460]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vbnAetcC'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726db06-7a0b-4bc4-a9dc-3864fd89fd2d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb62064-5094-4ce3-89f4-5ce474ed51b4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:27 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:27 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[48368b4a-4763-467e-8064-672d76502996]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260]
Oct 16 07:33:27 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260] successful.
Oct 16 07:33:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[55abb84c-6f57-4382-9f2d-145fb676b698]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ccea4-a50d-4d49-8946-9375408f034f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:27 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:27 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:27 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:27 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe02a34-493b-4d10-ba49-8f1218258a71]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbnAetcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26463376133383435', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463376133383435', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPOZSCJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:28 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[408b541d-c0b2-4bd8-b0b6-0f4fd8074bfb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:33:28 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac69333-5e38-4388-877f-cd291a9f7985]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4] added
Oct 16 07:33:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7527c7-b234-42ba-bcd0-248de19034f3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5865e10f-5a83-447c-bda8-221b08281dc5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPOZSCJe {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QPOZSCJe" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c09526-3d92-4128-bab4-1d46c343b341]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QPOZSCJe'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980e004-c912-48a0-b06f-b015dec9d285]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747be8e-ea71-4d37-83ea-005b4f2ee40b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4095c275-cb7c-46b2-a5ba-f4205ef770b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260]
Oct 16 07:33:28 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260] successful.
Oct 16 07:33:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95adee6-16ea-48d3-ac10-c4cebb412cc1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f33b7-aebe-419e-8adc-fc4e5f570839]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:28 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1304057-145e-4f1e-8a03-b5206f34c39a]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:33:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPOZSCJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26330626464343261', 'path': '/dev/sdc'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330626464343261', 'path': '/dev/sdc'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZHtpxnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:29 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:29 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:29 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dbfd7b-a0fa-48f0-bc7f-51e782731420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:33:29 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b131426-b20e-4d5e-98c3-00b9e3b5d634]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123] added
Oct 16 07:33:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8f9f0-385e-4f19-a0df-549a6fffbced]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[52578420-0b03-447f-8381-9d522613f0fe]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZHtpxnf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KZHtpxnf" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2450eb5-4f9e-47a1-9aa6-8cca2f0164cc]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KZHtpxnf'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a99101e-1711-45a8-a5ef-e8070b120fa2]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cedc09d-19c3-4a49-99eb-91e822746913]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea023a61-08f4-4830-9f64-856683a2f32e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260]
Oct 16 07:33:30 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260] successful.
Oct 16 07:33:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[511fa512-22b6-4957-800c-e34fcdb6bd2a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4589dfc1-6965-429a-84d6-5729c16623f7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:33:30 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6902fa82-fb7c-487e-b92f-fbe5af8bfec4]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZHtpxnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23764316466363465', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764316466363465', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:db,bridge_name='br-int',has_traffic_filtering=True,id=56cb8287-904e-40a5-96f5-e3fe40bab932,network=Network(17de1dd9-a119-4f7c-b67f-23b76ba7bf8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cb8287-90') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:d3:5e,bridge_name='br-int',has_traffic_filtering=True,id=ebcead91-8bdd-4ee0-9330-eae5e2a70a57,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebcead91-8b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:6f:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef9cb5e1-52c9-4cae-b45c-fd094fdb7559,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef9cb5e1-52') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:95:51,bridge_name='br-int',has_traffic_filtering=True,id=75ddfca1-10f7-4921-a68e-a9b8a68bebf4,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ddfca1-10') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:33:21,bridge_name='br-int',has_traffic_filtering=True,id=f2ece950-a502-4a05-95d2-1a4980191018,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ece950-a5') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:af:c6,bridge_name='br-int',has_traffic_filtering=True,id=532333ef-8a62-43fb-a297-4fe3b13af87f,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532333ef-8a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=37b98f03-614b-4b5c-84b1-ff770ea66ba9,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b98f03-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.objects.instance [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lazy-loading 'pci_devices' on Instance uuid 87991349-e339-4fcf-b4ef-52936a931511 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:33:31 user nova-compute[74080]:   <uuid>87991349-e339-4fcf-b4ef-52936a931511</uuid>
Oct 16 07:33:31 user nova-compute[74080]:   <name>instance-0000000b</name>
Oct 16 07:33:31 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:33:31 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:33:31 user nova-compute[74080]:   <metadata>
Oct 16 07:33:31 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:33:31 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:33:31 user nova-compute[74080]:       <nova:name>tempest-device-tagging-server-1608925191</nova:name>
Oct 16 07:33:31 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:33:27</nova:creationTime>
Oct 16 07:33:31 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:33:31 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:33:31 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:33:31 user nova-compute[74080]:       <nova:owner>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:user uuid="3aa035c155654d148bc7a99d7334c302">tempest-TaggedBootDevicesTest-397809528-project-member</nova:user>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:project uuid="81c8059ab6ba44de94098ef28e33cfd1">tempest-TaggedBootDevicesTest-397809528</nova:project>
Oct 16 07:33:31 user nova-compute[74080]:       </nova:owner>
Oct 16 07:33:31 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:33:31 user nova-compute[74080]:       <nova:ports>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:port uuid="56cb8287-904e-40a5-96f5-e3fe40bab932">
Oct 16 07:33:31 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 07:33:31 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:port uuid="ebcead91-8bdd-4ee0-9330-eae5e2a70a57">
Oct 16 07:33:31 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.172" ipVersion="4"/>
Oct 16 07:33:31 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:port uuid="ef9cb5e1-52c9-4cae-b45c-fd094fdb7559">
Oct 16 07:33:31 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Oct 16 07:33:31 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:port uuid="75ddfca1-10f7-4921-a68e-a9b8a68bebf4">
Oct 16 07:33:31 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Oct 16 07:33:31 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:port uuid="f2ece950-a502-4a05-95d2-1a4980191018">
Oct 16 07:33:31 user nova-compute[74080]:           <nova:ip type="fixed" address="10.1.1.232" ipVersion="4"/>
Oct 16 07:33:31 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:port uuid="532333ef-8a62-43fb-a297-4fe3b13af87f">
Oct 16 07:33:31 user nova-compute[74080]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 16 07:33:31 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:31 user nova-compute[74080]:         <nova:port uuid="37b98f03-614b-4b5c-84b1-ff770ea66ba9">
Oct 16 07:33:31 user nova-compute[74080]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 16 07:33:31 user nova-compute[74080]:         </nova:port>
Oct 16 07:33:31 user nova-compute[74080]:       </nova:ports>
Oct 16 07:33:31 user nova-compute[74080]:     </nova:instance>
Oct 16 07:33:31 user nova-compute[74080]:   </metadata>
Oct 16 07:33:31 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:33:31 user nova-compute[74080]:     <system>
Oct 16 07:33:31 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:33:31 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:33:31 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:33:31 user nova-compute[74080]:       <entry name="serial">87991349-e339-4fcf-b4ef-52936a931511</entry>
Oct 16 07:33:31 user nova-compute[74080]:       <entry name="uuid">87991349-e339-4fcf-b4ef-52936a931511</entry>
Oct 16 07:33:31 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:33:31 user nova-compute[74080]:     </system>
Oct 16 07:33:31 user nova-compute[74080]:   </sysinfo>
Oct 16 07:33:31 user nova-compute[74080]:   <os>
Oct 16 07:33:31 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:33:31 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:33:31 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:33:31 user nova-compute[74080]:   </os>
Oct 16 07:33:31 user nova-compute[74080]:   <features>
Oct 16 07:33:31 user nova-compute[74080]:     <acpi/>
Oct 16 07:33:31 user nova-compute[74080]:     <apic/>
Oct 16 07:33:31 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:33:31 user nova-compute[74080]:   </features>
Oct 16 07:33:31 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:33:31 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:33:31 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:33:31 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:33:31 user nova-compute[74080]:   </clock>
Oct 16 07:33:31 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:33:31 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:33:31 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:33:31 user nova-compute[74080]:   </cpu>
Oct 16 07:33:31 user nova-compute[74080]:   <devices>
Oct 16 07:33:31 user nova-compute[74080]:     <disk type="file" device="cdrom">
Oct 16 07:33:31 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 07:33:31 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511/disk.config"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="hda" bus="ide"/>
Oct 16 07:33:31 user nova-compute[74080]:     </disk>
Oct 16 07:33:31 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:33:31 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:33:31 user nova-compute[74080]:       <source dev="/dev/sdb"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <serial>ef9e8398-a4e0-4fea-b500-4e4344ef77e3</serial>
Oct 16 07:33:31 user nova-compute[74080]:     </disk>
Oct 16 07:33:31 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:33:31 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:33:31 user nova-compute[74080]:       <source dev="/dev/sdc"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <serial>2faf61ec-a1c7-445c-a7de-aefab2c773a4</serial>
Oct 16 07:33:31 user nova-compute[74080]:     </disk>
Oct 16 07:33:31 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:33:31 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:33:31 user nova-compute[74080]:       <source dev="/dev/sdd"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="vdc" bus="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <serial>1bf17329-c5af-40ad-b992-8912de4e6123</serial>
Oct 16 07:33:31 user nova-compute[74080]:     </disk>
Oct 16 07:33:31 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:31 user nova-compute[74080]:       <mac address="fa:16:3e:ed:32:db"/>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="tap56cb8287-90"/>
Oct 16 07:33:31 user nova-compute[74080]:     </interface>
Oct 16 07:33:31 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:31 user nova-compute[74080]:       <mac address="fa:16:3e:f3:d3:5e"/>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="tapebcead91-8b"/>
Oct 16 07:33:31 user nova-compute[74080]:     </interface>
Oct 16 07:33:31 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:31 user nova-compute[74080]:       <mac address="fa:16:3e:24:6f:2f"/>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="tapef9cb5e1-52"/>
Oct 16 07:33:31 user nova-compute[74080]:     </interface>
Oct 16 07:33:31 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:31 user nova-compute[74080]:       <mac address="fa:16:3e:54:95:51"/>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="tap75ddfca1-10"/>
Oct 16 07:33:31 user nova-compute[74080]:     </interface>
Oct 16 07:33:31 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:31 user nova-compute[74080]:       <mac address="fa:16:3e:78:33:21"/>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="tapf2ece950-a5"/>
Oct 16 07:33:31 user nova-compute[74080]:     </interface>
Oct 16 07:33:31 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:31 user nova-compute[74080]:       <mac address="fa:16:3e:a9:af:c6"/>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="tap532333ef-8a"/>
Oct 16 07:33:31 user nova-compute[74080]:     </interface>
Oct 16 07:33:31 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:33:31 user nova-compute[74080]:       <mac address="fa:16:3e:37:9e:8b"/>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:33:31 user nova-compute[74080]:       <target dev="tap37b98f03-61"/>
Oct 16 07:33:31 user nova-compute[74080]:     </interface>
Oct 16 07:33:31 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:33:31 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511/console.log" append="off"/>
Oct 16 07:33:31 user nova-compute[74080]:     </serial>
Oct 16 07:33:31 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:33:31 user nova-compute[74080]:     <video>
Oct 16 07:33:31 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:33:31 user nova-compute[74080]:     </video>
Oct 16 07:33:31 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:33:31 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:33:31 user nova-compute[74080]:     </rng>
Oct 16 07:33:31 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:33:31 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:33:31 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:33:31 user nova-compute[74080]:     </memballoon>
Oct 16 07:33:31 user nova-compute[74080]:   </devices>
Oct 16 07:33:31 user nova-compute[74080]: </domain>
Oct 16 07:33:31 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:db,bridge_name='br-int',has_traffic_filtering=True,id=56cb8287-904e-40a5-96f5-e3fe40bab932,network=Network(17de1dd9-a119-4f7c-b67f-23b76ba7bf8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cb8287-90') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:db,bridge_name='br-int',has_traffic_filtering=True,id=56cb8287-904e-40a5-96f5-e3fe40bab932,network=Network(17de1dd9-a119-4f7c-b67f-23b76ba7bf8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cb8287-90') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8fe78a05-2c24-5971-8a97-441db75bb396', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56cb8287-90, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56cb8287-90, col_values=(('qos', UUID('95c1f635-9daf-4188-90fd-2cf601b084c8')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56cb8287-90, col_values=(('external_ids', {'iface-id': '56cb8287-904e-40a5-96f5-e3fe40bab932', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:32:db', 'vm-uuid': '87991349-e339-4fcf-b4ef-52936a931511'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: INFO os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:32:db,bridge_name='br-int',has_traffic_filtering=True,id=56cb8287-904e-40a5-96f5-e3fe40bab932,network=Network(17de1dd9-a119-4f7c-b67f-23b76ba7bf8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cb8287-90')
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:d3:5e,bridge_name='br-int',has_traffic_filtering=True,id=ebcead91-8bdd-4ee0-9330-eae5e2a70a57,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebcead91-8b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:d3:5e,bridge_name='br-int',has_traffic_filtering=True,id=ebcead91-8bdd-4ee0-9330-eae5e2a70a57,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebcead91-8b') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fedc2e44-2631-549c-8a31-502be9bd2eaa', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebcead91-8b, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebcead91-8b, col_values=(('qos', UUID('da4c0f7b-0562-45a8-bd24-fccfe87f961a')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebcead91-8b, col_values=(('external_ids', {'iface-id': 'ebcead91-8bdd-4ee0-9330-eae5e2a70a57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:d3:5e', 'vm-uuid': '87991349-e339-4fcf-b4ef-52936a931511'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: INFO os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:d3:5e,bridge_name='br-int',has_traffic_filtering=True,id=ebcead91-8bdd-4ee0-9330-eae5e2a70a57,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebcead91-8b')
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:6f:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef9cb5e1-52c9-4cae-b45c-fd094fdb7559,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef9cb5e1-52') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6f:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef9cb5e1-52c9-4cae-b45c-fd094fdb7559,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef9cb5e1-52') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43e9a853-3857-5858-86e1-3bc96a2fdb5d', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef9cb5e1-52, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef9cb5e1-52, col_values=(('qos', UUID('314964a0-ab01-4529-9783-6d4dc21e3f4d')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef9cb5e1-52, col_values=(('external_ids', {'iface-id': 'ef9cb5e1-52c9-4cae-b45c-fd094fdb7559', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:6f:2f', 'vm-uuid': '87991349-e339-4fcf-b4ef-52936a931511'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: INFO os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6f:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef9cb5e1-52c9-4cae-b45c-fd094fdb7559,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef9cb5e1-52')
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:95:51,bridge_name='br-int',has_traffic_filtering=True,id=75ddfca1-10f7-4921-a68e-a9b8a68bebf4,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ddfca1-10') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:95:51,bridge_name='br-int',has_traffic_filtering=True,id=75ddfca1-10f7-4921-a68e-a9b8a68bebf4,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ddfca1-10') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b942eb5e-2e7f-5e3d-8469-874ef4c65684', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75ddfca1-10, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75ddfca1-10, col_values=(('qos', UUID('f687d32d-0009-4a09-912d-51a198c8cbb5')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75ddfca1-10, col_values=(('external_ids', {'iface-id': '75ddfca1-10f7-4921-a68e-a9b8a68bebf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:95:51', 'vm-uuid': '87991349-e339-4fcf-b4ef-52936a931511'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: INFO os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:95:51,bridge_name='br-int',has_traffic_filtering=True,id=75ddfca1-10f7-4921-a68e-a9b8a68bebf4,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ddfca1-10')
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:33:21,bridge_name='br-int',has_traffic_filtering=True,id=f2ece950-a502-4a05-95d2-1a4980191018,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ece950-a5') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:33:21,bridge_name='br-int',has_traffic_filtering=True,id=f2ece950-a502-4a05-95d2-1a4980191018,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ece950-a5') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d92d503-421f-55f4-83f8-c97305c3ad43', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2ece950-a5, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2ece950-a5, col_values=(('qos', UUID('9c416a6d-4034-498e-9695-1d8fbb4c19db')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2ece950-a5, col_values=(('external_ids', {'iface-id': 'f2ece950-a502-4a05-95d2-1a4980191018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:33:21', 'vm-uuid': '87991349-e339-4fcf-b4ef-52936a931511'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: INFO os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:33:21,bridge_name='br-int',has_traffic_filtering=True,id=f2ece950-a502-4a05-95d2-1a4980191018,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ece950-a5')
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:af:c6,bridge_name='br-int',has_traffic_filtering=True,id=532333ef-8a62-43fb-a297-4fe3b13af87f,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532333ef-8a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:af:c6,bridge_name='br-int',has_traffic_filtering=True,id=532333ef-8a62-43fb-a297-4fe3b13af87f,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532333ef-8a') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '266d26db-dbf0-5ef5-9690-48df2ef3536f', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap532333ef-8a, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap532333ef-8a, col_values=(('qos', UUID('2c74d2f6-2b0e-4f0f-820c-ccd86f287d8c')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap532333ef-8a, col_values=(('external_ids', {'iface-id': '532333ef-8a62-43fb-a297-4fe3b13af87f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:af:c6', 'vm-uuid': '87991349-e339-4fcf-b4ef-52936a931511'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: INFO os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:af:c6,bridge_name='br-int',has_traffic_filtering=True,id=532333ef-8a62-43fb-a297-4fe3b13af87f,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532333ef-8a')
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=37b98f03-614b-4b5c-84b1-ff770ea66ba9,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b98f03-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=37b98f03-614b-4b5c-84b1-ff770ea66ba9,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b98f03-61') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1b5ec3f-07cb-512e-a7de-269f77b494b6', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37b98f03-61, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37b98f03-61, col_values=(('qos', UUID('7da7489f-36b4-46ce-9d97-dac9eb752404')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37b98f03-61, col_values=(('external_ids', {'iface-id': '37b98f03-614b-4b5c-84b1-ff770ea66ba9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:9e:8b', 'vm-uuid': '87991349-e339-4fcf-b4ef-52936a931511'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:31 user nova-compute[74080]: INFO os_vif [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=37b98f03-614b-4b5c-84b1-ff770ea66ba9,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b98f03-61')
Oct 16 07:33:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] No BDM found with device name hda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:33:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:33:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] No VIF found with MAC fa:16:3e:ed:32:db, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:33:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] No VIF found with MAC fa:16:3e:78:33:21, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:33:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Using config drive
Oct 16 07:33:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Creating config drive at /opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511/disk.config
Oct 16 07:33:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5dix2ikc {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5dix2ikc" returned: 0 in 0.058s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-78920990-09aa-4624-9c41-0a355d7c62f5 req-420deb29-85c2-41ae-97d4-b07382747477 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-78920990-09aa-4624-9c41-0a355d7c62f5 req-420deb29-85c2-41ae-97d4-b07382747477 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-78920990-09aa-4624-9c41-0a355d7c62f5 req-420deb29-85c2-41ae-97d4-b07382747477 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-78920990-09aa-4624-9c41-0a355d7c62f5 req-420deb29-85c2-41ae-97d4-b07382747477 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-78920990-09aa-4624-9c41-0a355d7c62f5 req-420deb29-85c2-41ae-97d4-b07382747477 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:34 user nova-compute[74080]: WARNING nova.compute.manager [req-78920990-09aa-4624-9c41-0a355d7c62f5 req-420deb29-85c2-41ae-97d4-b07382747477 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 for instance with vm_state building and task_state spawning.
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-4ac9b1af-34ca-4f41-9143-d9738a111af3 req-1f1793b7-fdb1-439e-a7e9-b57bfd3f3010 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4ac9b1af-34ca-4f41-9143-d9738a111af3 req-1f1793b7-fdb1-439e-a7e9-b57bfd3f3010 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4ac9b1af-34ca-4f41-9143-d9738a111af3 req-1f1793b7-fdb1-439e-a7e9-b57bfd3f3010 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4ac9b1af-34ca-4f41-9143-d9738a111af3 req-1f1793b7-fdb1-439e-a7e9-b57bfd3f3010 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG nova.compute.manager [req-4ac9b1af-34ca-4f41-9143-d9738a111af3 req-1f1793b7-fdb1-439e-a7e9-b57bfd3f3010 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:35 user nova-compute[74080]: WARNING nova.compute.manager [req-4ac9b1af-34ca-4f41-9143-d9738a111af3 req-1f1793b7-fdb1-439e-a7e9-b57bfd3f3010 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 for instance with vm_state building and task_state spawning.
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Port 1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 binding to destination host user is already ACTIVE {{(pid=74080) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:36 user nova-compute[74080]: WARNING nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 for instance with vm_state building and task_state spawning.
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:36 user nova-compute[74080]: WARNING nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 for instance with vm_state building and task_state spawning.
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:36 user nova-compute[74080]: WARNING nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 for instance with vm_state building and task_state spawning.
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:36 user nova-compute[74080]: WARNING nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 for instance with vm_state building and task_state spawning.
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:36 user nova-compute[74080]: WARNING nova.compute.manager [req-eed600b0-7049-4cbe-be0e-961018fc37f5 req-4b2ca2e6-501e-44c6-91fb-6c5928982253 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 for instance with vm_state building and task_state spawning.
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-fce70773-8e10-4da6-b9a6-25368b728056 req-f208d3a8-a615-442f-b6af-70efc1c16961 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fce70773-8e10-4da6-b9a6-25368b728056 req-f208d3a8-a615-442f-b6af-70efc1c16961 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fce70773-8e10-4da6-b9a6-25368b728056 req-f208d3a8-a615-442f-b6af-70efc1c16961 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fce70773-8e10-4da6-b9a6-25368b728056 req-f208d3a8-a615-442f-b6af-70efc1c16961 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-fce70773-8e10-4da6-b9a6-25368b728056 req-f208d3a8-a615-442f-b6af-70efc1c16961 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:36 user nova-compute[74080]: WARNING nova.compute.manager [req-fce70773-8e10-4da6-b9a6-25368b728056 req-f208d3a8-a615-442f-b6af-70efc1c16961 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f for instance with vm_state building and task_state spawning.
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.network.neutron [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Creating tmpfile /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/tmpdcghbrt0 to verify with other compute node that the instance is on the same shared storage. {{(pid=74080) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:37 user nova-compute[74080]: WARNING nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 for instance with vm_state building and task_state spawning.
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:37 user nova-compute[74080]: WARNING nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 for instance with vm_state building and task_state spawning.
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:37 user nova-compute[74080]: WARNING nova.compute.manager [req-c280dbb6-f7b4-4fbb-aaab-7b324967307e req-07a23507-d66d-4064-94cc-e89b83a48fe9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 for instance with vm_state building and task_state spawning.
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance destroyed successfully.
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.objects.instance [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lazy-loading 'resources' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_vif [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1184cb83-61, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0231991-5832-4c86-9833-b0884bd4ce69) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:33:38 user nova-compute[74080]: INFO os_vif [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61')
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:38 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0343ca0c-1d4d-4b56-8a7c-afd23dcdb970]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:33:38 user nova-compute[74080]: No targets found.
Oct 16 07:33:38 user nova-compute[74080]: iSNS:
Oct 16 07:33:38 user nova-compute[74080]: No targets found.
Oct 16 07:33:38 user nova-compute[74080]: STATIC:
Oct 16 07:33:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123
Oct 16 07:33:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:33:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:33:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4
Oct 16 07:33:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3
Oct 16 07:33:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:38 user nova-compute[74080]: FIRMWARE:
Oct 16 07:33:38 user nova-compute[74080]: No targets found.
Oct 16 07:33:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:33:38 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:33:38 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe1751-9aaf-42f4-8a7e-a6f0c801027c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[383b6438-99d0-4c84-9a83-a88cd51ab611]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:33:38 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac426290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805'): ({'sdf'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Removing single pathed devices sdf {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56e28f7-a262-4655-a8ca-95f887abc762]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02963f6-652d-49ca-8999-44cf7a8e4a7b]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flushing IO for device /dev/sdf {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aead5c-8504-4338-81be-72bb8e4593b5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9363c9e3-2adb-4238-811c-45779740a812]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0063c1fb-aae7-4445-8b26-52a2b166744d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fe89d3-73d0-4593-911c-f568aa5a7b0d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]
Oct 16 07:33:38 user nova-compute[74080]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.
Oct 16 07:33:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[876cc75a-f79c-4b29-b8c5-c655146bfcc3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== disconnect_volume: return (331ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:38 user nova-compute[74080]: WARNING nova.compute.manager [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 for instance with vm_state building and task_state spawning.
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:38 user nova-compute[74080]: WARNING nova.compute.manager [req-1f167202-3de2-4401-a17d-333adedcad8e req-0c624725-ecb5-4727-b282-bbf13250a66c service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 for instance with vm_state building and task_state spawning.
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-2478e4ba-56bc-489e-9fcc-32b21bb5597e req-2aadc211-65f9-447e-9f04-af9c2e5ef07d service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2478e4ba-56bc-489e-9fcc-32b21bb5597e req-2aadc211-65f9-447e-9f04-af9c2e5ef07d service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2478e4ba-56bc-489e-9fcc-32b21bb5597e req-2aadc211-65f9-447e-9f04-af9c2e5ef07d service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2478e4ba-56bc-489e-9fcc-32b21bb5597e req-2aadc211-65f9-447e-9f04-af9c2e5ef07d service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-2478e4ba-56bc-489e-9fcc-32b21bb5597e req-2aadc211-65f9-447e-9f04-af9c2e5ef07d service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:38 user nova-compute[74080]: WARNING nova.compute.manager [req-2478e4ba-56bc-489e-9fcc-32b21bb5597e req-2aadc211-65f9-447e-9f04-af9c2e5ef07d service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f for instance with vm_state building and task_state spawning.
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:33:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance spawned successfully.
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:33:39 user nova-compute[74080]: INFO nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Took 12.12 seconds to spawn the instance on the hypervisor.
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:33:39 user nova-compute[74080]: INFO nova.compute.manager [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Took 141.98 seconds to build instance.
Oct 16 07:33:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-313b682e-013e-414c-9968-62024bc09fba tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "87991349-e339-4fcf-b4ef-52936a931511" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 142.176s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:39 user nova-compute[74080]: WARNING nova.compute.manager [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state resized and task_state resize_reverting.
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:33:39 user nova-compute[74080]: WARNING nova.compute.manager [req-e0959c18-ccfe-4f89-85ab-61abe784cfc7 req-0f9c06a2-1ecb-4ce7-91f8-8861e3b0aadc service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state resized and task_state resize_reverting.
Oct 16 07:33:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:33:46 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 is timed out.
Oct 16 07:33:46 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully detached device vdb from instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 from the live domain config.
Oct 16 07:33:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmlwjHgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:46 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:33:46 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb92179-9e4f-4000-b753-5c1268600fe8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:33:46 user nova-compute[74080]: No targets found.
Oct 16 07:33:46 user nova-compute[74080]: iSNS:
Oct 16 07:33:46 user nova-compute[74080]: No targets found.
Oct 16 07:33:46 user nova-compute[74080]: STATIC:
Oct 16 07:33:46 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123
Oct 16 07:33:46 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:46 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:46 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba
Oct 16 07:33:46 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:46 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:46 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4
Oct 16 07:33:46 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:46 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:46 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3
Oct 16 07:33:46 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:33:46 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:33:46 user nova-compute[74080]: FIRMWARE:
Oct 16 07:33:46 user nova-compute[74080]: No targets found.
Oct 16 07:33:46 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:33:46 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:33:46 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b874fe-3e8d-4dda-9485-6f110135ee9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:33:46 user nova-compute[74080]: INFO nova.compute.claims [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Claim successful on node user
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c58072-1c84-4732-81b9-8e06ec56f7c4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:47 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:47 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:33:47 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:47 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:33:47 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:33:47 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:33:47 user nova-compute[74080]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba (non-flash)
Oct 16 07:33:47 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac41d1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba'): ({'sde'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Removing single pathed devices sde {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f31e5fc-e4b8-46e9-8172-78ac374656d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbb0c95-7586-42ee-ab56-8ace94200ce5]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flushing IO for device /dev/sde {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7fe5c9-17f1-4ce8-b6d3-7018d90a7216]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed7169-1e63-4de6-b9e9-e02fe794d5ff]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[17273dd1-527f-48c4-8ea9-03e0bbc68b9a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4395c1e-fcb2-48a0-9cf3-7c3654fd6427]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260]
Oct 16 07:33:47 user nova-compute[74080]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba, portal: 172.16.0.220,3260] successful.
Oct 16 07:33:47 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e7ac34b-c1b3-444b-8216-b2ef2babecba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bae1360-b945-4b43-b9af-a4ac85e703cc]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== disconnect_volume: return (396ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:33:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:33:47 user nova-compute[74080]: INFO nova.virt.block_device [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Booting with volume 7b4ab4cc-fc59-408a-a868-cfbdef70a3cf at /dev/vda
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.policy [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f9ce6a7e3fc4f1c8edab7788688213a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd056746711e9427e84183bb13bdf386b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.utils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d8450-8a0e-4d1d-9944-346307d7d9dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e3b53d-1ecc-4eed-88b6-38cfb55d4a7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aa1e1c-fc9f-428c-98c8-4f3042b3e810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad7fc39-257e-4828-8e61-fae3d2baa137]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:33:47 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:33:47 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb034f-eb6f-4b57-bb94-678e1664b3ca]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG os_brick.utils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:47 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updating existing volume attachment record: 5ac5eddd-95ed-46e2-a0ad-c94225548f93 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:33:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:33:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:33:48 user nova-compute[74080]: DEBUG nova.objects.instance [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lazy-loading 'migration_context' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:33:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Successfully created port: c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:33:48 user nova-compute[74080]: DEBUG nova.objects.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Object Instance<e4b3aaca-821e-410f-83c1-7287a48c7723> lazy-loaded attributes: resources,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.760s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.objects.instance [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88520a44-5923-414f-9cc0-4acf4be256da tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.100s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:33:49 user nova-compute[74080]: INFO nova.compute.manager [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Swapping old allocation on dict_keys(['b5aa9fe6-2f98-4919-84cb-476610cf1fc7']) held by migration 885bd991-2f2e-433a-ba8d-461991be5fed for instance
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Overwriting current allocation {'allocations': {'b5aa9fe6-2f98-4919-84cb-476610cf1fc7': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 18}}, 'project_id': '0746934362024577ae7fd2846d1c2ec7', 'user_id': '5bba0d0c7a2d4fb3a757aa0abdfa1a2e', 'consumer_generation': 1} on consumer e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Successfully updated port: c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquired lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-changed-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Refreshing instance network info cache due to event network-changed-c792e524-2ccb-4033-9db1-56ccf22a11be. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] Acquiring lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:33:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updating instance_info_cache with network_info: [{"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Releasing lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance network_info: |[{"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] Acquired lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Refreshing network info cache for port c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG nova.network.neutron [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG os_brick.utils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c337e9-eb39-4251-8372-2ce378519f3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aaf82e-a750-44dd-b7a0-e8097e2ec3d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c037b078-c77e-4094-bd63-f4531d2f91c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[76962161-d595-423f-b2c6-81b89b833d36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:33:50 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:33:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbabbfb-e0dd-4dbe-9883-45f6cac26b45]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:33:50 user nova-compute[74080]: DEBUG os_brick.utils [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:33:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updated VIF entry in instance network info cache for port c792e524-2ccb-4033-9db1-56ccf22a11be. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:33:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updating instance_info_cache with network_info: [{"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:33:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8474848e-b013-4dca-a020-b24e805a5853 req-f2f6836c-2e2c-405c-b50b-bc3eb6dfaa96 service nova] Releasing lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:33:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:33:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "dd394796-510c-4990-aaa7-7f479173c476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "dd394796-510c-4990-aaa7-7f479173c476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:00 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:34:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:00 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:34:00 user nova-compute[74080]: INFO nova.compute.claims [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Claim successful on node user
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.network.neutron [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:34:01 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.policy [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c63d981ba0f4e5fa162e8f2cd6064b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee952431351406291cab2310d4a54fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:34:01 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Creating image(s)
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "/opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "/opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.279s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.238s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk 1073741824" returned: 0 in 0.061s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.202s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG nova.network.neutron [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Successfully created port: e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Cannot resize image /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Ensure instance console log exists: /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG nova.network.neutron [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Successfully updated port: e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquired lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG nova.network.neutron [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Received event network-changed-e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Refreshing instance network info cache due to event network-changed-e6a36ae1-ea7b-4e90-b70d-424902807b64. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] Acquiring lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:34:03 user nova-compute[74080]: DEBUG nova.network.neutron [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.neutron [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updating instance_info_cache with network_info: [{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Releasing lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Instance network_info: |[{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] Acquired lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.neutron [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Refreshing network info cache for port e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Start _get_guest_xml network_info=[{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:34:04 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:04 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2082567727',display_name='tempest-ServerActionsTestOtherA-server-2082567727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2082567727',id=15,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZLgcCjtOjRhtVEk66lTNvJCeVtg0/HRqeB+2N63b7XuoepjdGinmp3abF9v/R3VFjwY/zIQcPIO8tqTm4LN5wPV1fx01ZgUseGdlfitkfPwyEsROdJBfZEWEz0lOUgsQ==',key_name='tempest-keypair-108407981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-qn0fw8uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=dd394796-510c-4990-aaa7-7f479173c476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6a36ae1-ea7b-4e90-b70d-424902807b64,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a36ae1-ea') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.objects.instance [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'pci_devices' on Instance uuid dd394796-510c-4990-aaa7-7f479173c476 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:34:04 user nova-compute[74080]:   <uuid>dd394796-510c-4990-aaa7-7f479173c476</uuid>
Oct 16 07:34:04 user nova-compute[74080]:   <name>instance-0000000f</name>
Oct 16 07:34:04 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:34:04 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:34:04 user nova-compute[74080]:   <metadata>
Oct 16 07:34:04 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:34:04 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:34:04 user nova-compute[74080]:       <nova:name>tempest-ServerActionsTestOtherA-server-2082567727</nova:name>
Oct 16 07:34:04 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:34:04</nova:creationTime>
Oct 16 07:34:04 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:34:04 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:34:04 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:34:04 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:34:04 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:34:04 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:34:04 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:34:04 user nova-compute[74080]:       <nova:owner>
Oct 16 07:34:04 user nova-compute[74080]:         <nova:user uuid="0c63d981ba0f4e5fa162e8f2cd6064b9">tempest-ServerActionsTestOtherA-481627845-project-member</nova:user>
Oct 16 07:34:04 user nova-compute[74080]:         <nova:project uuid="0ee952431351406291cab2310d4a54fd">tempest-ServerActionsTestOtherA-481627845</nova:project>
Oct 16 07:34:04 user nova-compute[74080]:       </nova:owner>
Oct 16 07:34:04 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:34:04 user nova-compute[74080]:       <nova:ports>
Oct 16 07:34:04 user nova-compute[74080]:         <nova:port uuid="e6a36ae1-ea7b-4e90-b70d-424902807b64">
Oct 16 07:34:04 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:34:04 user nova-compute[74080]:         </nova:port>
Oct 16 07:34:04 user nova-compute[74080]:       </nova:ports>
Oct 16 07:34:04 user nova-compute[74080]:     </nova:instance>
Oct 16 07:34:04 user nova-compute[74080]:   </metadata>
Oct 16 07:34:04 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:34:04 user nova-compute[74080]:     <system>
Oct 16 07:34:04 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:34:04 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:34:04 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:34:04 user nova-compute[74080]:       <entry name="serial">dd394796-510c-4990-aaa7-7f479173c476</entry>
Oct 16 07:34:04 user nova-compute[74080]:       <entry name="uuid">dd394796-510c-4990-aaa7-7f479173c476</entry>
Oct 16 07:34:04 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:34:04 user nova-compute[74080]:     </system>
Oct 16 07:34:04 user nova-compute[74080]:   </sysinfo>
Oct 16 07:34:04 user nova-compute[74080]:   <os>
Oct 16 07:34:04 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:34:04 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:34:04 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:34:04 user nova-compute[74080]:   </os>
Oct 16 07:34:04 user nova-compute[74080]:   <features>
Oct 16 07:34:04 user nova-compute[74080]:     <acpi/>
Oct 16 07:34:04 user nova-compute[74080]:     <apic/>
Oct 16 07:34:04 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:34:04 user nova-compute[74080]:   </features>
Oct 16 07:34:04 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:34:04 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:34:04 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:34:04 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:34:04 user nova-compute[74080]:   </clock>
Oct 16 07:34:04 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:34:04 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:34:04 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:34:04 user nova-compute[74080]:   </cpu>
Oct 16 07:34:04 user nova-compute[74080]:   <devices>
Oct 16 07:34:04 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:34:04 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:34:04 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk"/>
Oct 16 07:34:04 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:34:04 user nova-compute[74080]:     </disk>
Oct 16 07:34:04 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:34:04 user nova-compute[74080]:       <mac address="fa:16:3e:cb:d0:4f"/>
Oct 16 07:34:04 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:04 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:34:04 user nova-compute[74080]:       <target dev="tape6a36ae1-ea"/>
Oct 16 07:34:04 user nova-compute[74080]:     </interface>
Oct 16 07:34:04 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:34:04 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/console.log" append="off"/>
Oct 16 07:34:04 user nova-compute[74080]:     </serial>
Oct 16 07:34:04 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:34:04 user nova-compute[74080]:     <video>
Oct 16 07:34:04 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:04 user nova-compute[74080]:     </video>
Oct 16 07:34:04 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:34:04 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:34:04 user nova-compute[74080]:     </rng>
Oct 16 07:34:04 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:34:04 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:34:04 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:34:04 user nova-compute[74080]:     </memballoon>
Oct 16 07:34:04 user nova-compute[74080]:   </devices>
Oct 16 07:34:04 user nova-compute[74080]: </domain>
Oct 16 07:34:04 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2082567727',display_name='tempest-ServerActionsTestOtherA-server-2082567727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2082567727',id=15,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZLgcCjtOjRhtVEk66lTNvJCeVtg0/HRqeB+2N63b7XuoepjdGinmp3abF9v/R3VFjwY/zIQcPIO8tqTm4LN5wPV1fx01ZgUseGdlfitkfPwyEsROdJBfZEWEz0lOUgsQ==',key_name='tempest-keypair-108407981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-qn0fw8uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=dd394796-510c-4990-aaa7-7f479173c476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6a36ae1-ea7b-4e90-b70d-424902807b64,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a36ae1-ea') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG os_vif [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6a36ae1-ea7b-4e90-b70d-424902807b64,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a36ae1-ea') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47836394-f2b4-5233-92aa-78279f892b3b', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6a36ae1-ea, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6a36ae1-ea, col_values=(('qos', UUID('a782c814-9f07-458f-bec0-3d04c3518458')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6a36ae1-ea, col_values=(('external_ids', {'iface-id': 'e6a36ae1-ea7b-4e90-b70d-424902807b64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:d0:4f', 'vm-uuid': 'dd394796-510c-4990-aaa7-7f479173c476'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:04 user nova-compute[74080]: INFO os_vif [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d0:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6a36ae1-ea7b-4e90-b70d-424902807b64,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a36ae1-ea')
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No VIF found with MAC fa:16:3e:cb:d0:4f, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.neutron [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updated VIF entry in instance network info cache for port e6a36ae1-ea7b-4e90-b70d-424902807b64. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG nova.network.neutron [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updating instance_info_cache with network_info: [{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-11bf0d85-5972-4d28-babb-04eef039d640 req-ffcc8307-0ca1-4864-bd55-b786d7ee5d17 service nova] Releasing lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-cbab29ea-f88e-473f-b089-295e1348a4e7 req-a1206799-1bcb-472a-9e03-35b50536617f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Received event network-vif-plugged-e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cbab29ea-f88e-473f-b089-295e1348a4e7 req-a1206799-1bcb-472a-9e03-35b50536617f service nova] Acquiring lock "dd394796-510c-4990-aaa7-7f479173c476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cbab29ea-f88e-473f-b089-295e1348a4e7 req-a1206799-1bcb-472a-9e03-35b50536617f service nova] Lock "dd394796-510c-4990-aaa7-7f479173c476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cbab29ea-f88e-473f-b089-295e1348a4e7 req-a1206799-1bcb-472a-9e03-35b50536617f service nova] Lock "dd394796-510c-4990-aaa7-7f479173c476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-cbab29ea-f88e-473f-b089-295e1348a4e7 req-a1206799-1bcb-472a-9e03-35b50536617f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] No waiting events found dispatching network-vif-plugged-e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:06 user nova-compute[74080]: WARNING nova.compute.manager [req-cbab29ea-f88e-473f-b089-295e1348a4e7 req-a1206799-1bcb-472a-9e03-35b50536617f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Received unexpected event network-vif-plugged-e6a36ae1-ea7b-4e90-b70d-424902807b64 for instance with vm_state building and task_state spawning.
Oct 16 07:34:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:34:08 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: dd394796-510c-4990-aaa7-7f479173c476] Instance spawned successfully.
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-0e81719c-3454-4ba2-9dcb-54d5746837c4 req-be765745-11ba-42bd-9e23-2ca48fc5e1d3 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Received event network-vif-plugged-e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0e81719c-3454-4ba2-9dcb-54d5746837c4 req-be765745-11ba-42bd-9e23-2ca48fc5e1d3 service nova] Acquiring lock "dd394796-510c-4990-aaa7-7f479173c476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0e81719c-3454-4ba2-9dcb-54d5746837c4 req-be765745-11ba-42bd-9e23-2ca48fc5e1d3 service nova] Lock "dd394796-510c-4990-aaa7-7f479173c476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0e81719c-3454-4ba2-9dcb-54d5746837c4 req-be765745-11ba-42bd-9e23-2ca48fc5e1d3 service nova] Lock "dd394796-510c-4990-aaa7-7f479173c476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-0e81719c-3454-4ba2-9dcb-54d5746837c4 req-be765745-11ba-42bd-9e23-2ca48fc5e1d3 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] No waiting events found dispatching network-vif-plugged-e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:08 user nova-compute[74080]: WARNING nova.compute.manager [req-0e81719c-3454-4ba2-9dcb-54d5746837c4 req-be765745-11ba-42bd-9e23-2ca48fc5e1d3 service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Received unexpected event network-vif-plugged-e6a36ae1-ea7b-4e90-b70d-424902807b64 for instance with vm_state building and task_state spawning.
Oct 16 07:34:08 user nova-compute[74080]: INFO nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Took 7.55 seconds to spawn the instance on the hypervisor.
Oct 16 07:34:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:34:09 user nova-compute[74080]: INFO nova.compute.manager [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: dd394796-510c-4990-aaa7-7f479173c476] Took 8.53 seconds to build instance.
Oct 16 07:34:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-46668c82-5336-4e4c-8033-b9db66b9c0bc tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "dd394796-510c-4990-aaa7-7f479173c476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.694s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:09 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:09 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 07:34:11 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:12 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Skipping network cache update for instance because it is Building. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:34:13 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lazy-loading 'info_cache' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:14 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-e4b3aaca-821e-410f-83c1-7287a48c7723" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:34:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:34:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:34:15 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:16 user nova-compute[74080]: INFO nova.compute.manager [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Terminating instance
Oct 16 07:34:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "41a5c934-14d2-469f-9fe6-d175ae886673" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "41a5c934-14d2-469f-9fe6-d175ae886673" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:16 user nova-compute[74080]: INFO nova.compute.manager [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Terminating instance
Oct 16 07:34:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG nova.compute.manager [req-359a42c2-fc3d-4cd1-8eeb-14f7f1bd8f6c req-2ec6ecc0-eb5d-4ae7-a0d1-8b8ccffe3382 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-unplugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-359a42c2-fc3d-4cd1-8eeb-14f7f1bd8f6c req-2ec6ecc0-eb5d-4ae7-a0d1-8b8ccffe3382 service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-359a42c2-fc3d-4cd1-8eeb-14f7f1bd8f6c req-2ec6ecc0-eb5d-4ae7-a0d1-8b8ccffe3382 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-359a42c2-fc3d-4cd1-8eeb-14f7f1bd8f6c req-2ec6ecc0-eb5d-4ae7-a0d1-8b8ccffe3382 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG nova.compute.manager [req-359a42c2-fc3d-4cd1-8eeb-14f7f1bd8f6c req-2ec6ecc0-eb5d-4ae7-a0d1-8b8ccffe3382 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-unplugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:16 user nova-compute[74080]: DEBUG nova.compute.manager [req-359a42c2-fc3d-4cd1-8eeb-14f7f1bd8f6c req-2ec6ecc0-eb5d-4ae7-a0d1-8b8ccffe3382 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-unplugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-985c41ba-d62d-473e-90da-14041c756d4a req-ad4ca89d-a3f3-4051-b6ea-53a6a4908c21 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received event network-vif-unplugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-985c41ba-d62d-473e-90da-14041c756d4a req-ad4ca89d-a3f3-4051-b6ea-53a6a4908c21 service nova] Acquiring lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-985c41ba-d62d-473e-90da-14041c756d4a req-ad4ca89d-a3f3-4051-b6ea-53a6a4908c21 service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-985c41ba-d62d-473e-90da-14041c756d4a req-ad4ca89d-a3f3-4051-b6ea-53a6a4908c21 service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-985c41ba-d62d-473e-90da-14041c756d4a req-ad4ca89d-a3f3-4051-b6ea-53a6a4908c21 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] No waiting events found dispatching network-vif-unplugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-985c41ba-d62d-473e-90da-14041c756d4a req-ad4ca89d-a3f3-4051-b6ea-53a6a4908c21 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received event network-vif-unplugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Instance destroyed successfully.
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.objects.instance [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'resources' on Instance uuid 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1462507476',display_name='tempest-AttachVolumeNegativeTest-server-1462507476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1462507476',id=3,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxrIrWWqawGXVR0rf/6sQvLx8mT2Qhh/8rM4LMRnJ1KOQSg5NZgHwE4Fqe4jkv0EMMnky9Eqrt14KZ5PSTCuRiPdMY4RMXJmAXW0wrl1f2KiAhndX/jAq4gkQ8buVky+g==',key_name='tempest-keypair-1529714285',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-4s0gqh7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "8165e494-572c-4bae-9f3b-da85a6f9c676", "address": "fa:16:3e:24:b7:32", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8165e494-57", "ovs_interfaceid": "8165e494-572c-4bae-9f3b-da85a6f9c676", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:b7:32,bridge_name='br-int',has_traffic_filtering=True,id=8165e494-572c-4bae-9f3b-da85a6f9c676,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8165e494-57') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG os_vif [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b7:32,bridge_name='br-int',has_traffic_filtering=True,id=8165e494-572c-4bae-9f3b-da85a6f9c676,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8165e494-57') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8165e494-57, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Instance destroyed successfully.
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.objects.instance [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lazy-loading 'resources' on Instance uuid 41a5c934-14d2-469f-9fe6-d175ae886673 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:32:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127629370',display_name='tempest-VolumesAdminNegativeTest-server-2127629370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127629370',id=12,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2464ccb4f24e319dadbd7d2edd64fd',ramdisk_id='',reservation_id='r-o6lvffg1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1570382741',owner_user_name='tempest-VolumesAdminNegativeTest-1570382741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:32:16Z,user_data=None,user_id='ebb8d2a523034e03b8bb5f09d5f720fa',uuid=41a5c934-14d2-469f-9fe6-d175ae886673,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converting VIF {"id": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "address": "fa:16:3e:d4:4c:f9", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d032a8-cc", "ovs_interfaceid": "98d032a8-cc77-476b-8bda-b1a00d4473a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=98d032a8-cc77-476b-8bda-b1a00d4473a6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d032a8-cc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG os_vif [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=98d032a8-cc77-476b-8bda-b1a00d4473a6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d032a8-cc') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98d032a8-cc, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2071304-f3c4-4fc5-960e-f0f220aab2fd) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b89062f-b992-404e-884f-f87b3028b0f9) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:17 user nova-compute[74080]: INFO os_vif [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:b7:32,bridge_name='br-int',has_traffic_filtering=True,id=8165e494-572c-4bae-9f3b-da85a6f9c676,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8165e494-57')
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Deleting instance files /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4_del
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Deletion of /opt/stack/data/nova/instances/8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4_del complete
Oct 16 07:34:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:17 user nova-compute[74080]: INFO os_vif [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=98d032a8-cc77-476b-8bda-b1a00d4473a6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d032a8-cc')
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Deleting instance files /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673_del
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Deletion of /opt/stack/data/nova/instances/41a5c934-14d2-469f-9fe6-d175ae886673_del complete
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.compute.manager [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 16 07:34:17 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:34:17 user nova-compute[74080]: INFO nova.compute.manager [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 16 07:34:17 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:34:17 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:19 user nova-compute[74080]: WARNING nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received unexpected event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with vm_state active and task_state deleting.
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:19 user nova-compute[74080]: WARNING nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received unexpected event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with vm_state active and task_state deleting.
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:19 user nova-compute[74080]: WARNING nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received unexpected event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with vm_state active and task_state deleting.
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-unplugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-unplugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-e1053c79-0afd-4991-a185-df09b34349a4 req-4c527c5f-f09f-4a89-810a-1a70d0e78415 service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-unplugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:19 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Took 1.28 seconds to deallocate network for instance.
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:19 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Took 1.61 seconds to deallocate network for instance.
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-5e8bbe44-75d3-4214-bf11-b81b7d08eff7 req-b2d40cff-c80f-4b15-a67e-6edca6db3fd1 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received event network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5e8bbe44-75d3-4214-bf11-b81b7d08eff7 req-b2d40cff-c80f-4b15-a67e-6edca6db3fd1 service nova] Acquiring lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5e8bbe44-75d3-4214-bf11-b81b7d08eff7 req-b2d40cff-c80f-4b15-a67e-6edca6db3fd1 service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5e8bbe44-75d3-4214-bf11-b81b7d08eff7 req-b2d40cff-c80f-4b15-a67e-6edca6db3fd1 service nova] Lock "41a5c934-14d2-469f-9fe6-d175ae886673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-5e8bbe44-75d3-4214-bf11-b81b7d08eff7 req-b2d40cff-c80f-4b15-a67e-6edca6db3fd1 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] No waiting events found dispatching network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:19 user nova-compute[74080]: WARNING nova.compute.manager [req-5e8bbe44-75d3-4214-bf11-b81b7d08eff7 req-b2d40cff-c80f-4b15-a67e-6edca6db3fd1 service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received unexpected event network-vif-plugged-98d032a8-cc77-476b-8bda-b1a00d4473a6 for instance with vm_state deleted and task_state None.
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.254s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:20 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Deleted allocations for instance 41a5c934-14d2-469f-9fe6-d175ae886673
Oct 16 07:34:20 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:20 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=8089MB free_disk=25.61461639404297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3e64ab04-9a3d-4724-aa83-a5f15d02334d tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "41a5c934-14d2-469f-9fe6-d175ae886673" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.593s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.806s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.270s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:20 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Deleted allocations for instance 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f055134f-7d13-4ee6-9dfa-11207791a674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 87991349-e339-4fcf-b4ef-52936a931511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1960a20e-bc74-4d96-8c0f-4f41e47ea82e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:34:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d40ff668-f1c7-42e7-8fe5-df90347217e1 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.247s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] There are 0 instances to clean {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] Acquiring lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] Lock "8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] No waiting events found dispatching network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:21 user nova-compute[74080]: WARNING nova.compute.manager [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received unexpected event network-vif-plugged-8165e494-572c-4bae-9f3b-da85a6f9c676 for instance with vm_state deleted and task_state None.
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] [instance: 41a5c934-14d2-469f-9fe6-d175ae886673] Received event network-vif-deleted-98d032a8-cc77-476b-8bda-b1a00d4473a6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-f141d7e7-af70-43cf-97c2-bacb167312dc req-63123a32-b5dd-4af9-b6ae-901092ff860d service nova] [instance: 8bc252ef-6da2-43f6-b7e3-b6c120fb7fa4] Received event network-vif-deleted-8165e494-572c-4bae-9f3b-da85a6f9c676 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:34:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Starting finish_revert_migration {{(pid=74080) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Start _get_guest_xml network_info=[{"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'be446c00-b14f-4a0f-8f78-b24a63ab6b29', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e4b3aaca-821e-410f-83c1-7287a48c7723', 'attached_at': '2023-10-16T07:34:26.000000', 'detached_at': '', 'volume_id': '2ca08889-064b-4c5b-99bf-069fe6a32805', 'serial': '2ca08889-064b-4c5b-99bf-069fe6a32805'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:34:26 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:26 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.objects.instance [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:34:26 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:34:26 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:34:26 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffea5a6-4063-41b2-8cb0-f8e5bce06f9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:34:26 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3edbc0-3fb0-4d50-b01b-ac3dd77a72d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805] added
Oct 16 07:34:26 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e081a3e8-c561-4a61-9e83-1d26800e87ff]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc08bd5-4555-4a41-9131-83fabed4abd0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAKLEMOy {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JAKLEMOy" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[da992fd3-c88b-45ea-97ac-52e78fdd998d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JAKLEMOy'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e7d96c-ab79-461b-a1b3-531e7ba5be34]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a421139-4b23-4808-a605-4e85f5db1578]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f86d249-e6bd-4daa-afa4-5c3d14c88fd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]
Oct 16 07:34:26 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.
Oct 16 07:34:26 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f54000-9b90-4b21-b4f0-4b1a6f6cbabc]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b724280f-2f64-4db3-8fdd-8f672ee31b67]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:26 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2ebd9-35bc-4b2e-8df6-e114bcb3acdf]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:26 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26632656334613731', 'path': '/dev/sde'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632656334613731', 'path': '/dev/sde'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:34:27 user nova-compute[74080]:   <uuid>e4b3aaca-821e-410f-83c1-7287a48c7723</uuid>
Oct 16 07:34:27 user nova-compute[74080]:   <name>instance-00000002</name>
Oct 16 07:34:27 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:34:27 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:34:27 user nova-compute[74080]:   <metadata>
Oct 16 07:34:27 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:34:27 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:34:27 user nova-compute[74080]:       <nova:name>tempest-ServerActionsTestOtherB-server-1311694320</nova:name>
Oct 16 07:34:27 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:34:26</nova:creationTime>
Oct 16 07:34:27 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:34:27 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:34:27 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:34:27 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:34:27 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:34:27 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:34:27 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:34:27 user nova-compute[74080]:       <nova:owner>
Oct 16 07:34:27 user nova-compute[74080]:         <nova:user uuid="5bba0d0c7a2d4fb3a757aa0abdfa1a2e">tempest-ServerActionsTestOtherB-885127344-project-member</nova:user>
Oct 16 07:34:27 user nova-compute[74080]:         <nova:project uuid="0746934362024577ae7fd2846d1c2ec7">tempest-ServerActionsTestOtherB-885127344</nova:project>
Oct 16 07:34:27 user nova-compute[74080]:       </nova:owner>
Oct 16 07:34:27 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:34:27 user nova-compute[74080]:       <nova:ports>
Oct 16 07:34:27 user nova-compute[74080]:         <nova:port uuid="1184cb83-61e9-4582-9ff1-1a62d2e9f4a4">
Oct 16 07:34:27 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:34:27 user nova-compute[74080]:         </nova:port>
Oct 16 07:34:27 user nova-compute[74080]:       </nova:ports>
Oct 16 07:34:27 user nova-compute[74080]:     </nova:instance>
Oct 16 07:34:27 user nova-compute[74080]:   </metadata>
Oct 16 07:34:27 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:34:27 user nova-compute[74080]:     <system>
Oct 16 07:34:27 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:34:27 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:34:27 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:34:27 user nova-compute[74080]:       <entry name="serial">e4b3aaca-821e-410f-83c1-7287a48c7723</entry>
Oct 16 07:34:27 user nova-compute[74080]:       <entry name="uuid">e4b3aaca-821e-410f-83c1-7287a48c7723</entry>
Oct 16 07:34:27 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:34:27 user nova-compute[74080]:     </system>
Oct 16 07:34:27 user nova-compute[74080]:   </sysinfo>
Oct 16 07:34:27 user nova-compute[74080]:   <os>
Oct 16 07:34:27 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:34:27 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:34:27 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:34:27 user nova-compute[74080]:   </os>
Oct 16 07:34:27 user nova-compute[74080]:   <features>
Oct 16 07:34:27 user nova-compute[74080]:     <acpi/>
Oct 16 07:34:27 user nova-compute[74080]:     <apic/>
Oct 16 07:34:27 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:34:27 user nova-compute[74080]:   </features>
Oct 16 07:34:27 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:34:27 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:34:27 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:34:27 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:34:27 user nova-compute[74080]:   </clock>
Oct 16 07:34:27 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:34:27 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:34:27 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:34:27 user nova-compute[74080]:   </cpu>
Oct 16 07:34:27 user nova-compute[74080]:   <devices>
Oct 16 07:34:27 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:34:27 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:34:27 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk"/>
Oct 16 07:34:27 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:34:27 user nova-compute[74080]:     </disk>
Oct 16 07:34:27 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:34:27 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:34:27 user nova-compute[74080]:       <source dev="/dev/sde"/>
Oct 16 07:34:27 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:34:27 user nova-compute[74080]:       <serial>2ca08889-064b-4c5b-99bf-069fe6a32805</serial>
Oct 16 07:34:27 user nova-compute[74080]:     </disk>
Oct 16 07:34:27 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:34:27 user nova-compute[74080]:       <mac address="fa:16:3e:29:3d:72"/>
Oct 16 07:34:27 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:27 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:34:27 user nova-compute[74080]:       <target dev="tap1184cb83-61"/>
Oct 16 07:34:27 user nova-compute[74080]:     </interface>
Oct 16 07:34:27 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:34:27 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/console.log" append="off"/>
Oct 16 07:34:27 user nova-compute[74080]:     </serial>
Oct 16 07:34:27 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:34:27 user nova-compute[74080]:     <video>
Oct 16 07:34:27 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:27 user nova-compute[74080]:     </video>
Oct 16 07:34:27 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:34:27 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:34:27 user nova-compute[74080]:     </rng>
Oct 16 07:34:27 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:34:27 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:34:27 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:34:27 user nova-compute[74080]:     </memballoon>
Oct 16 07:34:27 user nova-compute[74080]:   </devices>
Oct 16 07:34:27 user nova-compute[74080]: </domain>
Oct 16 07:34:27 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_vif [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45442e9b-be3e-5f95-8bbe-c9eede3e2487', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1184cb83-61, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1184cb83-61, col_values=(('qos', UUID('4d763ad2-3d4b-4c71-9c88-58d6d272f4fe')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1184cb83-61, col_values=(('external_ids', {'iface-id': '1184cb83-61e9-4582-9ff1-1a62d2e9f4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:3d:72', 'vm-uuid': 'e4b3aaca-821e-410f-83c1-7287a48c7723'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:27 user nova-compute[74080]: INFO os_vif [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61')
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:34:27 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Creating image(s)
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Ensure instance console log exists: /opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Start _get_guest_xml network_info=[{"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '5ac5eddd-95ed-46e2-a0ad-c94225548f93', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1960a20e-bc74-4d96-8c0f-4f41e47ea82e', 'attached_at': '', 'detached_at': '', 'volume_id': '7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'serial': '7b4ab4cc-fc59-408a-a868-cfbdef70a3cf'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:34:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:34:27 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:34:27 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:34:27 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b488a0-b69a-4cca-a579-5a4134b584ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:34:27 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf74122e-a9ac-410a-b829-a5a85f24cf0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf] added
Oct 16 07:34:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1173abd-c9c3-47ec-a3a1-4e900aad5b84]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2f4d91-aae6-424e-b88e-db8eb56e9827]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWniSGuR {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWniSGuR" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[556739dc-fc50-402f-bc84-ec5dfd37938c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MWniSGuR'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da1263a-2792-44df-a8f1-f7727528895f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[875f2b5b-a056-4d5e-b4e5-2c50216bd3c7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db049a5-e6a8-4fef-abdc-90c11397649e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]
Oct 16 07:34:28 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.
Oct 16 07:34:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e439c93d-7c3d-4ed0-8740-1cf26f22666b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c6420a-a843-466e-a715-4c2e4f58e5b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:28 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.035s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db6ad4-aa33-43cc-a2a6-67a213e6861d]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:34:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26436666663623561', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436666663623561', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687647800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-687647800',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWg4YdQesoVuM/WrNXQW+kIdOFM6JSECUZzdALHq04v1FQWToM3QSyK/Ofd2DdWjWBU+/BJZzQGaQqaBqWByl2HZtKVlxS1w7xeSk0FxNaH8bNrQPLeM2SYusDF4mUtQ==',key_name='tempest-keypair-1129031097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d056746711e9427e84183bb13bdf386b',ramdisk_id='',reservation_id='r-1w49mmmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-200374556',owner_user_name='tempest-ServerActionsV293TestJSON-200374556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ce6a7e3fc4f1c8edab7788688213a',uuid=1960a20e-bc74-4d96-8c0f-4f41e47ea82e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converting VIF {"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.objects.instance [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lazy-loading 'pci_devices' on Instance uuid 1960a20e-bc74-4d96-8c0f-4f41e47ea82e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:34:29 user nova-compute[74080]:   <uuid>1960a20e-bc74-4d96-8c0f-4f41e47ea82e</uuid>
Oct 16 07:34:29 user nova-compute[74080]:   <name>instance-0000000e</name>
Oct 16 07:34:29 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:34:29 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:34:29 user nova-compute[74080]:   <metadata>
Oct 16 07:34:29 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:34:29 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:34:29 user nova-compute[74080]:       <nova:name>tempest-ServerActionsV293TestJSON-server-687647800</nova:name>
Oct 16 07:34:29 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:34:27</nova:creationTime>
Oct 16 07:34:29 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:34:29 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:34:29 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:34:29 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:34:29 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:34:29 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:34:29 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:34:29 user nova-compute[74080]:       <nova:owner>
Oct 16 07:34:29 user nova-compute[74080]:         <nova:user uuid="4f9ce6a7e3fc4f1c8edab7788688213a">tempest-ServerActionsV293TestJSON-200374556-project-member</nova:user>
Oct 16 07:34:29 user nova-compute[74080]:         <nova:project uuid="d056746711e9427e84183bb13bdf386b">tempest-ServerActionsV293TestJSON-200374556</nova:project>
Oct 16 07:34:29 user nova-compute[74080]:       </nova:owner>
Oct 16 07:34:29 user nova-compute[74080]:       <nova:ports>
Oct 16 07:34:29 user nova-compute[74080]:         <nova:port uuid="c792e524-2ccb-4033-9db1-56ccf22a11be">
Oct 16 07:34:29 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 07:34:29 user nova-compute[74080]:         </nova:port>
Oct 16 07:34:29 user nova-compute[74080]:       </nova:ports>
Oct 16 07:34:29 user nova-compute[74080]:     </nova:instance>
Oct 16 07:34:29 user nova-compute[74080]:   </metadata>
Oct 16 07:34:29 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:34:29 user nova-compute[74080]:     <system>
Oct 16 07:34:29 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:34:29 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:34:29 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:34:29 user nova-compute[74080]:       <entry name="serial">1960a20e-bc74-4d96-8c0f-4f41e47ea82e</entry>
Oct 16 07:34:29 user nova-compute[74080]:       <entry name="uuid">1960a20e-bc74-4d96-8c0f-4f41e47ea82e</entry>
Oct 16 07:34:29 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:34:29 user nova-compute[74080]:     </system>
Oct 16 07:34:29 user nova-compute[74080]:   </sysinfo>
Oct 16 07:34:29 user nova-compute[74080]:   <os>
Oct 16 07:34:29 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:34:29 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:34:29 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:34:29 user nova-compute[74080]:   </os>
Oct 16 07:34:29 user nova-compute[74080]:   <features>
Oct 16 07:34:29 user nova-compute[74080]:     <acpi/>
Oct 16 07:34:29 user nova-compute[74080]:     <apic/>
Oct 16 07:34:29 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:34:29 user nova-compute[74080]:   </features>
Oct 16 07:34:29 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:34:29 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:34:29 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:34:29 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:34:29 user nova-compute[74080]:   </clock>
Oct 16 07:34:29 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:34:29 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:34:29 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:34:29 user nova-compute[74080]:   </cpu>
Oct 16 07:34:29 user nova-compute[74080]:   <devices>
Oct 16 07:34:29 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:34:29 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:34:29 user nova-compute[74080]:       <source dev="/dev/sdf"/>
Oct 16 07:34:29 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:34:29 user nova-compute[74080]:       <serial>7b4ab4cc-fc59-408a-a868-cfbdef70a3cf</serial>
Oct 16 07:34:29 user nova-compute[74080]:     </disk>
Oct 16 07:34:29 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:34:29 user nova-compute[74080]:       <mac address="fa:16:3e:9d:8d:46"/>
Oct 16 07:34:29 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:29 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:34:29 user nova-compute[74080]:       <target dev="tapc792e524-2c"/>
Oct 16 07:34:29 user nova-compute[74080]:     </interface>
Oct 16 07:34:29 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:34:29 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e/console.log" append="off"/>
Oct 16 07:34:29 user nova-compute[74080]:     </serial>
Oct 16 07:34:29 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:34:29 user nova-compute[74080]:     <video>
Oct 16 07:34:29 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:29 user nova-compute[74080]:     </video>
Oct 16 07:34:29 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:34:29 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:34:29 user nova-compute[74080]:     </rng>
Oct 16 07:34:29 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:34:29 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:34:29 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:34:29 user nova-compute[74080]:     </memballoon>
Oct 16 07:34:29 user nova-compute[74080]:   </devices>
Oct 16 07:34:29 user nova-compute[74080]: </domain>
Oct 16 07:34:29 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-687647800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-687647800',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWg4YdQesoVuM/WrNXQW+kIdOFM6JSECUZzdALHq04v1FQWToM3QSyK/Ofd2DdWjWBU+/BJZzQGaQqaBqWByl2HZtKVlxS1w7xeSk0FxNaH8bNrQPLeM2SYusDF4mUtQ==',key_name='tempest-keypair-1129031097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d056746711e9427e84183bb13bdf386b',ramdisk_id='',reservation_id='r-1w49mmmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-200374556',owner_user_name='tempest-ServerActionsV293TestJSON-200374556-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ce6a7e3fc4f1c8edab7788688213a',uuid=1960a20e-bc74-4d96-8c0f-4f41e47ea82e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converting VIF {"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG os_vif [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a446f08-35af-50f5-a584-854b50e129d4', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc792e524-2c, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc792e524-2c, col_values=(('qos', UUID('43bc0499-9587-4c37-9d87-ae82900cf71f')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc792e524-2c, col_values=(('external_ids', {'iface-id': 'c792e524-2ccb-4033-9db1-56ccf22a11be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:8d:46', 'vm-uuid': '1960a20e-bc74-4d96-8c0f-4f41e47ea82e'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: INFO os_vif [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c')
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] No VIF found with MAC fa:16:3e:9d:8d:46, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-a95086eb-ace9-456c-b7d1-a5e45ef4498b req-897a7146-0bed-4989-b17e-a58170a902a2 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a95086eb-ace9-456c-b7d1-a5e45ef4498b req-897a7146-0bed-4989-b17e-a58170a902a2 service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a95086eb-ace9-456c-b7d1-a5e45ef4498b req-897a7146-0bed-4989-b17e-a58170a902a2 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a95086eb-ace9-456c-b7d1-a5e45ef4498b req-897a7146-0bed-4989-b17e-a58170a902a2 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-a95086eb-ace9-456c-b7d1-a5e45ef4498b req-897a7146-0bed-4989-b17e-a58170a902a2 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:29 user nova-compute[74080]: WARNING nova.compute.manager [req-a95086eb-ace9-456c-b7d1-a5e45ef4498b req-897a7146-0bed-4989-b17e-a58170a902a2 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state resized and task_state resize_reverting.
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:30 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:30 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:30 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-8ee5e185-330f-4d78-b861-be294c35025b req-9193276e-f910-4e53-b8de-1db7b2547e62 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8ee5e185-330f-4d78-b861-be294c35025b req-9193276e-f910-4e53-b8de-1db7b2547e62 service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8ee5e185-330f-4d78-b861-be294c35025b req-9193276e-f910-4e53-b8de-1db7b2547e62 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8ee5e185-330f-4d78-b861-be294c35025b req-9193276e-f910-4e53-b8de-1db7b2547e62 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-8ee5e185-330f-4d78-b861-be294c35025b req-9193276e-f910-4e53-b8de-1db7b2547e62 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:31 user nova-compute[74080]: WARNING nova.compute.manager [req-8ee5e185-330f-4d78-b861-be294c35025b req-9193276e-f910-4e53-b8de-1db7b2547e62 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received unexpected event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with vm_state building and task_state spawning.
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-9a735802-ddf2-4d7a-a8b4-9fc73ef0ddb0 req-e15c5f65-c92c-4eff-829c-525c91177430 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9a735802-ddf2-4d7a-a8b4-9fc73ef0ddb0 req-e15c5f65-c92c-4eff-829c-525c91177430 service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9a735802-ddf2-4d7a-a8b4-9fc73ef0ddb0 req-e15c5f65-c92c-4eff-829c-525c91177430 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9a735802-ddf2-4d7a-a8b4-9fc73ef0ddb0 req-e15c5f65-c92c-4eff-829c-525c91177430 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-9a735802-ddf2-4d7a-a8b4-9fc73ef0ddb0 req-e15c5f65-c92c-4eff-829c-525c91177430 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:31 user nova-compute[74080]: WARNING nova.compute.manager [req-9a735802-ddf2-4d7a-a8b4-9fc73ef0ddb0 req-e15c5f65-c92c-4eff-829c-525c91177430 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state resized and task_state resize_reverting.
Oct 16 07:34:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:34:31 user nova-compute[74080]: INFO nova.compute.claims [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Claim successful on node user
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:34:31 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.network.neutron [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:34:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.policy [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '205681b03ef0499498c2a4231fb10d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5b90e1ba3d5457aa21d6ceb148ad7c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:34:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Creating image(s)
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "/opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "/opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "/opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.compute.manager [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance running successfully.
Oct 16 07:34:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] finish_revert_migration finished successfully. {{(pid=74080) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.214s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk 1073741824" returned: 0 in 0.066s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:32 user nova-compute[74080]: INFO nova.compute.manager [None req-458c0f28-afb2-4506-a038-1cd37c613e1b tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance to original state: 'active'
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Successfully created port: feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.225s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-0703ed90-e317-47b9-993e-bd0053e6b7a3 req-2bd53549-d32a-4793-bd01-a0d07c1d974b service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0703ed90-e317-47b9-993e-bd0053e6b7a3 req-2bd53549-d32a-4793-bd01-a0d07c1d974b service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0703ed90-e317-47b9-993e-bd0053e6b7a3 req-2bd53549-d32a-4793-bd01-a0d07c1d974b service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0703ed90-e317-47b9-993e-bd0053e6b7a3 req-2bd53549-d32a-4793-bd01-a0d07c1d974b service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-0703ed90-e317-47b9-993e-bd0053e6b7a3 req-2bd53549-d32a-4793-bd01-a0d07c1d974b service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:33 user nova-compute[74080]: WARNING nova.compute.manager [req-0703ed90-e317-47b9-993e-bd0053e6b7a3 req-2bd53549-d32a-4793-bd01-a0d07c1d974b service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received unexpected event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with vm_state building and task_state spawning.
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Cannot resize image /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Ensure instance console log exists: /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:34:33 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance spawned successfully.
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:33 user nova-compute[74080]: INFO nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Took 5.74 seconds to spawn the instance on the hypervisor.
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:34:33 user nova-compute[74080]: INFO nova.compute.manager [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Took 46.71 seconds to build instance.
Oct 16 07:34:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1c0636aa-3441-4b0f-9dc6-4600b010947b tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.876s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Successfully updated port: feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquired lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.neutron [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-changed-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Refreshing instance network info cache due to event network-changed-feb8314e-fc63-4c2a-ba40-139d9a84938d. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] Acquiring lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.neutron [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.neutron [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Updating instance_info_cache with network_info: [{"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Releasing lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Instance network_info: |[{"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] Acquired lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Refreshing network info cache for port feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Start _get_guest_xml network_info=[{"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:34:34 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:34 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-323399632',display_name='tempest-TestVolumeSwap-server-323399632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-323399632',id=16,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTgTwbJfdiSrsBexBHftLSBMdQDwwR4tgx8UseF2/sfJnZhxmCnQ0zOovueF1ah5hHLE/YJQsXtJZrvzjeDmghvgohG6WkjrB3PFMnEuEw5SXfs7SjbxBxUXZe3A2QHyw==',key_name='tempest-keypair-45346034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5b90e1ba3d5457aa21d6ceb148ad7c4',ramdisk_id='',reservation_id='r-c305tszu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-196380766',owner_user_name='tempest-TestVolumeSwap-196380766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='205681b03ef0499498c2a4231fb10d46',uuid=56ba6ebf-6771-4004-81b2-3f416ba0fb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Converting VIF {"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:02,bridge_name='br-int',has_traffic_filtering=True,id=feb8314e-fc63-4c2a-ba40-139d9a84938d,network=Network(91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb8314e-fc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.objects.instance [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lazy-loading 'pci_devices' on Instance uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:34:34 user nova-compute[74080]:   <uuid>56ba6ebf-6771-4004-81b2-3f416ba0fb84</uuid>
Oct 16 07:34:34 user nova-compute[74080]:   <name>instance-00000010</name>
Oct 16 07:34:34 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:34:34 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:34:34 user nova-compute[74080]:   <metadata>
Oct 16 07:34:34 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:34:34 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:34:34 user nova-compute[74080]:       <nova:name>tempest-TestVolumeSwap-server-323399632</nova:name>
Oct 16 07:34:34 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:34:34</nova:creationTime>
Oct 16 07:34:34 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:34:34 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:34:34 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:34:34 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:34:34 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:34:34 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:34:34 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:34:34 user nova-compute[74080]:       <nova:owner>
Oct 16 07:34:34 user nova-compute[74080]:         <nova:user uuid="205681b03ef0499498c2a4231fb10d46">tempest-TestVolumeSwap-196380766-project-member</nova:user>
Oct 16 07:34:34 user nova-compute[74080]:         <nova:project uuid="e5b90e1ba3d5457aa21d6ceb148ad7c4">tempest-TestVolumeSwap-196380766</nova:project>
Oct 16 07:34:34 user nova-compute[74080]:       </nova:owner>
Oct 16 07:34:34 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:34:34 user nova-compute[74080]:       <nova:ports>
Oct 16 07:34:34 user nova-compute[74080]:         <nova:port uuid="feb8314e-fc63-4c2a-ba40-139d9a84938d">
Oct 16 07:34:34 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 07:34:34 user nova-compute[74080]:         </nova:port>
Oct 16 07:34:34 user nova-compute[74080]:       </nova:ports>
Oct 16 07:34:34 user nova-compute[74080]:     </nova:instance>
Oct 16 07:34:34 user nova-compute[74080]:   </metadata>
Oct 16 07:34:34 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:34:34 user nova-compute[74080]:     <system>
Oct 16 07:34:34 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:34:34 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:34:34 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:34:34 user nova-compute[74080]:       <entry name="serial">56ba6ebf-6771-4004-81b2-3f416ba0fb84</entry>
Oct 16 07:34:34 user nova-compute[74080]:       <entry name="uuid">56ba6ebf-6771-4004-81b2-3f416ba0fb84</entry>
Oct 16 07:34:34 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:34:34 user nova-compute[74080]:     </system>
Oct 16 07:34:34 user nova-compute[74080]:   </sysinfo>
Oct 16 07:34:34 user nova-compute[74080]:   <os>
Oct 16 07:34:34 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:34:34 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:34:34 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:34:34 user nova-compute[74080]:   </os>
Oct 16 07:34:34 user nova-compute[74080]:   <features>
Oct 16 07:34:34 user nova-compute[74080]:     <acpi/>
Oct 16 07:34:34 user nova-compute[74080]:     <apic/>
Oct 16 07:34:34 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:34:34 user nova-compute[74080]:   </features>
Oct 16 07:34:34 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:34:34 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:34:34 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:34:34 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:34:34 user nova-compute[74080]:   </clock>
Oct 16 07:34:34 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:34:34 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:34:34 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:34:34 user nova-compute[74080]:   </cpu>
Oct 16 07:34:34 user nova-compute[74080]:   <devices>
Oct 16 07:34:34 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:34:34 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:34:34 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk"/>
Oct 16 07:34:34 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:34:34 user nova-compute[74080]:     </disk>
Oct 16 07:34:34 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:34:34 user nova-compute[74080]:       <mac address="fa:16:3e:45:05:02"/>
Oct 16 07:34:34 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:34 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:34:34 user nova-compute[74080]:       <target dev="tapfeb8314e-fc"/>
Oct 16 07:34:34 user nova-compute[74080]:     </interface>
Oct 16 07:34:34 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:34:34 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/console.log" append="off"/>
Oct 16 07:34:34 user nova-compute[74080]:     </serial>
Oct 16 07:34:34 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:34:34 user nova-compute[74080]:     <video>
Oct 16 07:34:34 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:34:34 user nova-compute[74080]:     </video>
Oct 16 07:34:34 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:34:34 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:34:34 user nova-compute[74080]:     </rng>
Oct 16 07:34:34 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:34:34 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:34:34 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:34:34 user nova-compute[74080]:     </memballoon>
Oct 16 07:34:34 user nova-compute[74080]:   </devices>
Oct 16 07:34:34 user nova-compute[74080]: </domain>
Oct 16 07:34:34 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-323399632',display_name='tempest-TestVolumeSwap-server-323399632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-323399632',id=16,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTgTwbJfdiSrsBexBHftLSBMdQDwwR4tgx8UseF2/sfJnZhxmCnQ0zOovueF1ah5hHLE/YJQsXtJZrvzjeDmghvgohG6WkjrB3PFMnEuEw5SXfs7SjbxBxUXZe3A2QHyw==',key_name='tempest-keypair-45346034',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5b90e1ba3d5457aa21d6ceb148ad7c4',ramdisk_id='',reservation_id='r-c305tszu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-196380766',owner_user_name='tempest-TestVolumeSwap-196380766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:34:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='205681b03ef0499498c2a4231fb10d46',uuid=56ba6ebf-6771-4004-81b2-3f416ba0fb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Converting VIF {"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:02,bridge_name='br-int',has_traffic_filtering=True,id=feb8314e-fc63-4c2a-ba40-139d9a84938d,network=Network(91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb8314e-fc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG os_vif [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:02,bridge_name='br-int',has_traffic_filtering=True,id=feb8314e-fc63-4c2a-ba40-139d9a84938d,network=Network(91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb8314e-fc') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e97cd7d-53f9-574a-90a3-de9070b1dd0a', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeb8314e-fc, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfeb8314e-fc, col_values=(('qos', UUID('78e4b027-d11f-4783-9f78-2ab828404ee4')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfeb8314e-fc, col_values=(('external_ids', {'iface-id': 'feb8314e-fc63-4c2a-ba40-139d9a84938d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:05:02', 'vm-uuid': '56ba6ebf-6771-4004-81b2-3f416ba0fb84'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:34 user nova-compute[74080]: INFO os_vif [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:05:02,bridge_name='br-int',has_traffic_filtering=True,id=feb8314e-fc63-4c2a-ba40-139d9a84938d,network=Network(91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb8314e-fc')
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] No VIF found with MAC fa:16:3e:45:05:02, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Updated VIF entry in instance network info cache for port feb8314e-fc63-4c2a-ba40-139d9a84938d. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:34:34 user nova-compute[74080]: DEBUG nova.network.neutron [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Updating instance_info_cache with network_info: [{"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6985c72e-83da-4f92-b4be-f3c1b0d0f771 req-1fbb74a1-954b-4758-9bc8-be9bffe35c6f service nova] Releasing lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-039ca559-b615-40ac-ae9a-d678a09fee7b req-b2591a97-7ddb-4757-831e-721e854c5a8d service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-039ca559-b615-40ac-ae9a-d678a09fee7b req-b2591a97-7ddb-4757-831e-721e854c5a8d service nova] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-039ca559-b615-40ac-ae9a-d678a09fee7b req-b2591a97-7ddb-4757-831e-721e854c5a8d service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-039ca559-b615-40ac-ae9a-d678a09fee7b req-b2591a97-7ddb-4757-831e-721e854c5a8d service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-039ca559-b615-40ac-ae9a-d678a09fee7b req-b2591a97-7ddb-4757-831e-721e854c5a8d service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] No waiting events found dispatching network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:36 user nova-compute[74080]: WARNING nova.compute.manager [req-039ca559-b615-40ac-ae9a-d678a09fee7b req-b2591a97-7ddb-4757-831e-721e854c5a8d service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received unexpected event network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d for instance with vm_state building and task_state spawning.
Oct 16 07:34:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-2e32b1c1-355c-453f-8df9-4341c82b8837 req-c3605bcf-63dd-488d-bcc0-984ea2a6b60b service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2e32b1c1-355c-453f-8df9-4341c82b8837 req-c3605bcf-63dd-488d-bcc0-984ea2a6b60b service nova] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2e32b1c1-355c-453f-8df9-4341c82b8837 req-c3605bcf-63dd-488d-bcc0-984ea2a6b60b service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2e32b1c1-355c-453f-8df9-4341c82b8837 req-c3605bcf-63dd-488d-bcc0-984ea2a6b60b service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-2e32b1c1-355c-453f-8df9-4341c82b8837 req-c3605bcf-63dd-488d-bcc0-984ea2a6b60b service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] No waiting events found dispatching network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:38 user nova-compute[74080]: WARNING nova.compute.manager [req-2e32b1c1-355c-453f-8df9-4341c82b8837 req-c3605bcf-63dd-488d-bcc0-984ea2a6b60b service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received unexpected event network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d for instance with vm_state building and task_state spawning.
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:34:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Instance spawned successfully.
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:34:38 user nova-compute[74080]: INFO nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Took 6.55 seconds to spawn the instance on the hypervisor.
Oct 16 07:34:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:34:39 user nova-compute[74080]: INFO nova.compute.manager [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Took 7.47 seconds to build instance.
Oct 16 07:34:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0efd43d0-3e6e-4eda-a96a-fdab9c0fcd6a tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.602s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 07:34:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:34:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:34:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-changed-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing instance network info cache due to event network-changed-56cb8287-904e-40a5-96f5-e3fe40bab932. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:34:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] Acquiring lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:34:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] Acquired lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:34:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Refreshing network info cache for port 56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:34:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:52 user nova-compute[74080]: DEBUG nova.network.neutron [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updated VIF entry in instance network info cache for port 56cb8287-904e-40a5-96f5-e3fe40bab932. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:34:52 user nova-compute[74080]: DEBUG nova.network.neutron [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [{"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-17b4fb8a-5f99-428c-9ff2-90f6afa835fd req-e37fb1c7-d7ae-4da7-9246-5f67b41f8960 service nova] Releasing lock "refresh_cache-87991349-e339-4fcf-b4ef-52936a931511" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:34:54 user nova-compute[74080]: DEBUG nova.compute.manager [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-changed-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:54 user nova-compute[74080]: DEBUG nova.compute.manager [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Refreshing instance network info cache due to event network-changed-8fb90376-ac0a-4d74-8a23-29564ea728a4. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:34:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] Acquiring lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:34:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] Acquired lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:34:54 user nova-compute[74080]: DEBUG nova.network.neutron [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Refreshing network info cache for port 8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:34:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG nova.network.neutron [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updated VIF entry in instance network info cache for port 8fb90376-ac0a-4d74-8a23-29564ea728a4. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG nova.network.neutron [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-94e99ca5-e6bf-463e-afe0-8610b9157d19 req-0a480d24-8887-4425-8cf9-26621639f8c2 service nova] Releasing lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "87991349-e339-4fcf-b4ef-52936a931511" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:55 user nova-compute[74080]: INFO nova.compute.manager [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Terminating instance
Oct 16 07:34:55 user nova-compute[74080]: DEBUG nova.compute.manager [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-d7f9cbaa-282a-41ad-bf6e-725ef6eceb66 req-2098f36a-0799-4691-92d1-9f7d98b6fa81 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d7f9cbaa-282a-41ad-bf6e-725ef6eceb66 req-2098f36a-0799-4691-92d1-9f7d98b6fa81 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d7f9cbaa-282a-41ad-bf6e-725ef6eceb66 req-2098f36a-0799-4691-92d1-9f7d98b6fa81 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d7f9cbaa-282a-41ad-bf6e-725ef6eceb66 req-2098f36a-0799-4691-92d1-9f7d98b6fa81 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-d7f9cbaa-282a-41ad-bf6e-725ef6eceb66 req-2098f36a-0799-4691-92d1-9f7d98b6fa81 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-unplugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-d7f9cbaa-282a-41ad-bf6e-725ef6eceb66 req-2098f36a-0799-4691-92d1-9f7d98b6fa81 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-56cb8287-904e-40a5-96f5-e3fe40bab932 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-3a45dff0-07fe-4c0e-9ff6-bc56d552582e req-2de64476-6ef6-4378-8385-2ba41be613b0 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3a45dff0-07fe-4c0e-9ff6-bc56d552582e req-2de64476-6ef6-4378-8385-2ba41be613b0 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3a45dff0-07fe-4c0e-9ff6-bc56d552582e req-2de64476-6ef6-4378-8385-2ba41be613b0 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3a45dff0-07fe-4c0e-9ff6-bc56d552582e req-2de64476-6ef6-4378-8385-2ba41be613b0 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-3a45dff0-07fe-4c0e-9ff6-bc56d552582e req-2de64476-6ef6-4378-8385-2ba41be613b0 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-unplugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-3a45dff0-07fe-4c0e-9ff6-bc56d552582e req-2de64476-6ef6-4378-8385-2ba41be613b0 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-532333ef-8a62-43fb-a297-4fe3b13af87f for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-unplugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:56 user nova-compute[74080]: WARNING nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-ebcead91-8bdd-4ee0-9330-eae5e2a70a57 for instance with vm_state active and task_state deleting.
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-unplugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-54f29c20-744b-47ff-ab9f-5cbfee5bac53 req-b9d61b8c-7414-4235-9c37-36a0e16ecce9 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-f2ece950-a502-4a05-95d2-1a4980191018 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Instance destroyed successfully.
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.objects.instance [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lazy-loading 'resources' on Instance uuid 87991349-e339-4fcf-b4ef-52936a931511 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:32:db,bridge_name='br-int',has_traffic_filtering=True,id=56cb8287-904e-40a5-96f5-e3fe40bab932,network=Network(17de1dd9-a119-4f7c-b67f-23b76ba7bf8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cb8287-90') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:32:db,bridge_name='br-int',has_traffic_filtering=True,id=56cb8287-904e-40a5-96f5-e3fe40bab932,network=Network(17de1dd9-a119-4f7c-b67f-23b76ba7bf8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cb8287-90') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56cb8287-90, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95c1f635-9daf-4188-90fd-2cf601b084c8) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:32:db,bridge_name='br-int',has_traffic_filtering=True,id=56cb8287-904e-40a5-96f5-e3fe40bab932,network=Network(17de1dd9-a119-4f7c-b67f-23b76ba7bf8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56cb8287-90')
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:d3:5e,bridge_name='br-int',has_traffic_filtering=True,id=ebcead91-8bdd-4ee0-9330-eae5e2a70a57,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebcead91-8b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:d3:5e,bridge_name='br-int',has_traffic_filtering=True,id=ebcead91-8bdd-4ee0-9330-eae5e2a70a57,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebcead91-8b') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebcead91-8b, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da4c0f7b-0562-45a8-bd24-fccfe87f961a) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:d3:5e,bridge_name='br-int',has_traffic_filtering=True,id=ebcead91-8bdd-4ee0-9330-eae5e2a70a57,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebcead91-8b')
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:6f:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef9cb5e1-52c9-4cae-b45c-fd094fdb7559,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef9cb5e1-52') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6f:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef9cb5e1-52c9-4cae-b45c-fd094fdb7559,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef9cb5e1-52') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef9cb5e1-52, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=314964a0-ab01-4529-9783-6d4dc21e3f4d) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:6f:2f,bridge_name='br-int',has_traffic_filtering=True,id=ef9cb5e1-52c9-4cae-b45c-fd094fdb7559,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapef9cb5e1-52')
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:95:51,bridge_name='br-int',has_traffic_filtering=True,id=75ddfca1-10f7-4921-a68e-a9b8a68bebf4,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ddfca1-10') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:95:51,bridge_name='br-int',has_traffic_filtering=True,id=75ddfca1-10f7-4921-a68e-a9b8a68bebf4,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ddfca1-10') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75ddfca1-10, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f687d32d-0009-4a09-912d-51a198c8cbb5) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:95:51,bridge_name='br-int',has_traffic_filtering=True,id=75ddfca1-10f7-4921-a68e-a9b8a68bebf4,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75ddfca1-10')
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:33:21,bridge_name='br-int',has_traffic_filtering=True,id=f2ece950-a502-4a05-95d2-1a4980191018,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ece950-a5') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:33:21,bridge_name='br-int',has_traffic_filtering=True,id=f2ece950-a502-4a05-95d2-1a4980191018,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ece950-a5') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2ece950-a5, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c416a6d-4034-498e-9695-1d8fbb4c19db) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:57 user nova-compute[74080]: WARNING nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-56cb8287-904e-40a5-96f5-e3fe40bab932 for instance with vm_state active and task_state deleting.
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-unplugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:57 user nova-compute[74080]: WARNING nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-ef9cb5e1-52c9-4cae-b45c-fd094fdb7559 for instance with vm_state active and task_state deleting.
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-unplugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c86804-2096-4c63-b4a6-5fba77344f52 req-d8ef22e4-9127-4a1c-8d44-3fc2d121a46b service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:33:21,bridge_name='br-int',has_traffic_filtering=True,id=f2ece950-a502-4a05-95d2-1a4980191018,network=Network(ef4dfbe4-9952-4207-b95a-ad3cc1a74373),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2ece950-a5')
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "532333ef-8a62-43fb-a297-4fe3b13af87f", "address": "fa:16:3e:a9:af:c6", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532333ef-8a", "ovs_interfaceid": "532333ef-8a62-43fb-a297-4fe3b13af87f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:af:c6,bridge_name='br-int',has_traffic_filtering=True,id=532333ef-8a62-43fb-a297-4fe3b13af87f,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532333ef-8a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:af:c6,bridge_name='br-int',has_traffic_filtering=True,id=532333ef-8a62-43fb-a297-4fe3b13af87f,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532333ef-8a') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap532333ef-8a, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c74d2f6-2b0e-4f0f-820c-ccd86f287d8c) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:af:c6,bridge_name='br-int',has_traffic_filtering=True,id=532333ef-8a62-43fb-a297-4fe3b13af87f,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532333ef-8a')
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T07:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1608925191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1608925191',id=11,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK3Yp3tF+TEFeQp0K9U6TsKAQBrCa6SZmL7WBEDE5KQhcj1DXReSrpdPa8Jd7+DBqI66Nd5xFYcbF8tjVv/FHhT0C/Pv29yrwTv3HqilSSUwRsNlU4QuVRYh75oibsZag==',key_name='tempest-keypair-434016923',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81c8059ab6ba44de94098ef28e33cfd1',ramdisk_id='',reservation_id='r-3no602n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-397809528',owner_user_name='tempest-TaggedBootDevicesTest-397809528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa035c155654d148bc7a99d7334c302',uuid=87991349-e339-4fcf-b4ef-52936a931511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converting VIF {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=37b98f03-614b-4b5c-84b1-ff770ea66ba9,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b98f03-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=37b98f03-614b-4b5c-84b1-ff770ea66ba9,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b98f03-61') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37b98f03-61, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7da7489f-36b4-46ce-9d97-dac9eb752404) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:57 user nova-compute[74080]: INFO os_vif [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:8b,bridge_name='br-int',has_traffic_filtering=True,id=37b98f03-614b-4b5c-84b1-ff770ea66ba9,network=Network(6a20f052-d226-4dc5-8678-ccf620276ea1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37b98f03-61')
Oct 16 07:34:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbnAetcC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:34:57 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5914b7c-1868-4aa3-953c-5a6037e08c0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:34:57 user nova-compute[74080]: No targets found.
Oct 16 07:34:57 user nova-compute[74080]: iSNS:
Oct 16 07:34:57 user nova-compute[74080]: No targets found.
Oct 16 07:34:57 user nova-compute[74080]: STATIC:
Oct 16 07:34:57 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123
Oct 16 07:34:57 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:57 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:57 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:34:57 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:57 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:57 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4
Oct 16 07:34:57 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:57 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:57 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:34:57 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:57 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:57 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3
Oct 16 07:34:57 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:57 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:57 user nova-compute[74080]: FIRMWARE:
Oct 16 07:34:57 user nova-compute[74080]: No targets found.
Oct 16 07:34:57 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:34:57 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:34:57 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4dc27-d2c9-48dd-b43c-6ac1a5e3bf50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2214bbcd-450a-463b-992e-b51c14dcb82c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac37a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3'): ({'sdb'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Removing single pathed devices sdb {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c13f658-e7ad-4c3a-90b5-79e5ae1d756b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fdaa73-24ad-4353-a133-d2e229a0fdaf]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Flushing IO for device /dev/sdb {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c34116-925d-45f0-b9d7-0a82966693fc]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4f4d59-032b-4558-b711-640ec2fafb1f]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b435be6-9e1a-40dc-bf80-d3f7a6c47650]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38afe0d1-e112-4fce-a0d8-f59a03801f55]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260]
Oct 16 07:34:58 user nova-compute[74080]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3, portal: 172.16.0.220,3260] successful.
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9e8398-a4e0-4fea-b500-4e4344ef77e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0f4d69-aa59-4b0b-9c05-d06bb985d29f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== disconnect_volume: return (375ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QPOZSCJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:34:58 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c069ae85-81d8-4504-9a98-c426d3363a79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:34:58 user nova-compute[74080]: No targets found.
Oct 16 07:34:58 user nova-compute[74080]: iSNS:
Oct 16 07:34:58 user nova-compute[74080]: No targets found.
Oct 16 07:34:58 user nova-compute[74080]: STATIC:
Oct 16 07:34:58 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123
Oct 16 07:34:58 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:58 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:58 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:34:58 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:58 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:58 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4
Oct 16 07:34:58 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:58 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:58 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:34:58 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:58 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:58 user nova-compute[74080]: FIRMWARE:
Oct 16 07:34:58 user nova-compute[74080]: No targets found.
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:34:58 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:34:58 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[66339bf6-eda0-40f7-ac11-72ec60784860]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac3e555-22e0-4073-a2f1-dd6154bc852f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac37a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4'): ({'sdc'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Removing single pathed devices sdc {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.compute.manager [req-87c19dfb-f2fa-4753-b8ef-ee93595b666d req-b6e29991-0460-4d8c-9e40-ce0a098728aa service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87c19dfb-f2fa-4753-b8ef-ee93595b666d req-b6e29991-0460-4d8c-9e40-ce0a098728aa service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87c19dfb-f2fa-4753-b8ef-ee93595b666d req-b6e29991-0460-4d8c-9e40-ce0a098728aa service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87c19dfb-f2fa-4753-b8ef-ee93595b666d req-b6e29991-0460-4d8c-9e40-ce0a098728aa service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.compute.manager [req-87c19dfb-f2fa-4753-b8ef-ee93595b666d req-b6e29991-0460-4d8c-9e40-ce0a098728aa service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:58 user nova-compute[74080]: WARNING nova.compute.manager [req-87c19dfb-f2fa-4753-b8ef-ee93595b666d req-b6e29991-0460-4d8c-9e40-ce0a098728aa service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-532333ef-8a62-43fb-a297-4fe3b13af87f for instance with vm_state active and task_state deleting.
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7222e38-95b9-4514-b133-290663242bbc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14274c7-59ec-4075-9449-c0c103ad9eab]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Flushing IO for device /dev/sdc {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec63c4c-5a34-4e88-bb5e-78827702b40d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ffcee-64e9-4b07-ba2b-65a9bfa6e09b]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.compute.manager [req-f4a5acc7-0dbb-4e24-a2cb-68058ba32346 req-7f2a0c9a-06bc-4db3-b730-3bb1496af47e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f4a5acc7-0dbb-4e24-a2cb-68058ba32346 req-7f2a0c9a-06bc-4db3-b730-3bb1496af47e service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f4a5acc7-0dbb-4e24-a2cb-68058ba32346 req-7f2a0c9a-06bc-4db3-b730-3bb1496af47e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f4a5acc7-0dbb-4e24-a2cb-68058ba32346 req-7f2a0c9a-06bc-4db3-b730-3bb1496af47e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.compute.manager [req-f4a5acc7-0dbb-4e24-a2cb-68058ba32346 req-7f2a0c9a-06bc-4db3-b730-3bb1496af47e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:58 user nova-compute[74080]: WARNING nova.compute.manager [req-f4a5acc7-0dbb-4e24-a2cb-68058ba32346 req-7f2a0c9a-06bc-4db3-b730-3bb1496af47e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-f2ece950-a502-4a05-95d2-1a4980191018 for instance with vm_state active and task_state deleting.
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da3a0c-bb98-437f-995f-5ec4aa266800]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da4f17c-ca2b-4be0-9554-0227c3f4be22]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260]
Oct 16 07:34:58 user nova-compute[74080]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4, portal: 172.16.0.220,3260] successful.
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2faf61ec-a1c7-445c-a7de-aefab2c773a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5688aa31-6dc9-453a-a0eb-0b311c4775f0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== disconnect_volume: return (379ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KZHtpxnf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:34:58 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db10c434-c3ec-44c8-863b-3e4a50291ce2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:34:58 user nova-compute[74080]: No targets found.
Oct 16 07:34:58 user nova-compute[74080]: iSNS:
Oct 16 07:34:58 user nova-compute[74080]: No targets found.
Oct 16 07:34:58 user nova-compute[74080]: STATIC:
Oct 16 07:34:58 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123
Oct 16 07:34:58 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:58 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:58 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:34:58 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:58 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:58 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:34:58 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:34:58 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:34:58 user nova-compute[74080]: FIRMWARE:
Oct 16 07:34:58 user nova-compute[74080]: No targets found.
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:34:58 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:34:58 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[71150e6b-dd5f-4c8b-bcd3-e714ab8c3494]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce53c77-8ec7-46ac-8bf3-8189d19f7a81]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:34:58 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:34:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac37a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123'): ({'sdd'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Removing single pathed devices sdd {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3ce9f8-7122-4768-9beb-77de43a9ffbe]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[debd7982-8af6-4cf9-8add-081d41ca3ee5]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Flushing IO for device /dev/sdd {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca6b0dd-4cfe-47cc-b38b-52c7ccab1e5a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5c5a39-790d-4f3f-ba79-034782e75b8c]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74c79e4-0a53-4130-8977-e68812ecaebf]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8299688e-1ff0-4ed1-ac69-4c4e4f206d61]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260]
Oct 16 07:34:59 user nova-compute[74080]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123, portal: 172.16.0.220,3260] successful.
Oct 16 07:34:59 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bf17329-c5af-40ad-b992-8912de4e6123 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[afab7c98-cc53-42eb-bd4c-eb50badd49ab]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] <== disconnect_volume: return (377ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:34:59 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Deleting instance files /opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511_del
Oct 16 07:34:59 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Deletion of /opt/stack/data/nova/instances/87991349-e339-4fcf-b4ef-52936a931511_del complete
Oct 16 07:34:59 user nova-compute[74080]: INFO nova.compute.manager [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Took 3.95 seconds to destroy the instance on the hypervisor.
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 87991349-e339-4fcf-b4ef-52936a931511] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:59 user nova-compute[74080]: WARNING nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 for instance with vm_state active and task_state deleting.
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-unplugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-unplugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] Lock "87991349-e339-4fcf-b4ef-52936a931511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:34:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] No waiting events found dispatching network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:34:59 user nova-compute[74080]: WARNING nova.compute.manager [req-80ca8bf6-9720-4231-836f-25087d3719fc req-10843a7f-5edc-4851-bff7-fa85de7af06e service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received unexpected event network-vif-plugged-37b98f03-614b-4b5c-84b1-ff770ea66ba9 for instance with vm_state active and task_state deleting.
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:01 user nova-compute[74080]: WARNING nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid f055134f-7d13-4ee6-9dfa-11207791a674 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 1960a20e-bc74-4d96-8c0f-4f41e47ea82e {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid dd394796-510c-4990-aaa7-7f479173c476 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 87991349-e339-4fcf-b4ef-52936a931511 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "dd394796-510c-4990-aaa7-7f479173c476" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "dd394796-510c-4990-aaa7-7f479173c476" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "87991349-e339-4fcf-b4ef-52936a931511" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "dd394796-510c-4990-aaa7-7f479173c476" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-7696b8c3-664b-4cd8-ba74-c225a1c93529 req-1b8ed7b7-f086-47de-92cd-2329fc692fff service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-deleted-532333ef-8a62-43fb-a297-4fe3b13af87f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:01 user nova-compute[74080]: INFO nova.compute.manager [req-7696b8c3-664b-4cd8-ba74-c225a1c93529 req-1b8ed7b7-f086-47de-92cd-2329fc692fff service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Neutron deleted interface 532333ef-8a62-43fb-a297-4fe3b13af87f; detaching it from the instance and deleting it from the info cache
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.network.neutron [req-7696b8c3-664b-4cd8-ba74-c225a1c93529 req-1b8ed7b7-f086-47de-92cd-2329fc692fff service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [{"id": "56cb8287-904e-40a5-96f5-e3fe40bab932", "address": "fa:16:3e:ed:32:db", "network": {"id": "17de1dd9-a119-4f7c-b67f-23b76ba7bf8f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-719651224-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56cb8287-90", "ovs_interfaceid": "56cb8287-904e-40a5-96f5-e3fe40bab932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-7696b8c3-664b-4cd8-ba74-c225a1c93529 req-1b8ed7b7-f086-47de-92cd-2329fc692fff service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Detach interface failed, port_id=532333ef-8a62-43fb-a297-4fe3b13af87f, reason: Instance 87991349-e339-4fcf-b4ef-52936a931511 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:35:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-deleted-56cb8287-904e-40a5-96f5-e3fe40bab932 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:03 user nova-compute[74080]: INFO nova.compute.manager [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Neutron deleted interface 56cb8287-904e-40a5-96f5-e3fe40bab932; detaching it from the instance and deleting it from the info cache
Oct 16 07:35:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [{"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "address": "fa:16:3e:37:9e:8b", "network": {"id": "6a20f052-d226-4dc5-8678-ccf620276ea1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1600756541", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37b98f03-61", "ovs_interfaceid": "37b98f03-614b-4b5c-84b1-ff770ea66ba9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Detach interface failed, port_id=56cb8287-904e-40a5-96f5-e3fe40bab932, reason: Instance 87991349-e339-4fcf-b4ef-52936a931511 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:35:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-deleted-37b98f03-614b-4b5c-84b1-ff770ea66ba9 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:03 user nova-compute[74080]: INFO nova.compute.manager [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Neutron deleted interface 37b98f03-614b-4b5c-84b1-ff770ea66ba9; detaching it from the instance and deleting it from the info cache
Oct 16 07:35:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [{"id": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "address": "fa:16:3e:f3:d3:5e", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.172", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebcead91-8b", "ovs_interfaceid": "ebcead91-8bdd-4ee0-9330-eae5e2a70a57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "address": "fa:16:3e:24:6f:2f", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef9cb5e1-52", "ovs_interfaceid": "ef9cb5e1-52c9-4cae-b45c-fd094fdb7559", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "address": "fa:16:3e:54:95:51", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75ddfca1-10", "ovs_interfaceid": "75ddfca1-10f7-4921-a68e-a9b8a68bebf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2ece950-a502-4a05-95d2-1a4980191018", "address": "fa:16:3e:78:33:21", "network": {"id": "ef4dfbe4-9952-4207-b95a-ad3cc1a74373", "bridge": "br-int", "label": "tempest-device-tagging-net1-1235359287", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "81c8059ab6ba44de94098ef28e33cfd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2ece950-a5", "ovs_interfaceid": "f2ece950-a502-4a05-95d2-1a4980191018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-cbac3257-524e-47d4-a6b6-bf37bc923663 req-971df9e6-f130-4346-a573-692af87f4826 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Detach interface failed, port_id=37b98f03-614b-4b5c-84b1-ff770ea66ba9, reason: Instance 87991349-e339-4fcf-b4ef-52936a931511 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:35:05 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:05 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Took 5.90 seconds to deallocate network for instance.
Oct 16 07:35:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-7b0ff2c7-8bb0-48c0-b531-9628a73d41b3 req-2c62a9e7-e176-4428-b46c-312d01a28727 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-deleted-75ddfca1-10f7-4921-a68e-a9b8a68bebf4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-7b0ff2c7-8bb0-48c0-b531-9628a73d41b3 req-2c62a9e7-e176-4428-b46c-312d01a28727 service nova] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Received event network-vif-deleted-f2ece950-a502-4a05-95d2-1a4980191018 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:06 user nova-compute[74080]: INFO nova.compute.manager [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Attaching volume 82aa8960-04f1-4889-b389-ba67063042c9 to /dev/vdb
Oct 16 07:35:06 user nova-compute[74080]: DEBUG os_brick.utils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[86edd988-99ff-4648-b2b0-5ebee845022f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b8d960-a332-4763-94df-20a3c3e6ecb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[494ed164-e7dc-4823-adb2-e4296f0311a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[321de91b-557f-48e3-a73e-051f6d87d890]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:35:06 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:35:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[041248fb-d95e-4cc2-b08f-fbd126fadef8]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG os_brick.utils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:35:06 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating existing volume attachment record: c452eb71-4658-4161-961f-0812cd8f59be {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:35:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "20599029-1071-4ef0-8e85-825634645311" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:11 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:35:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:11 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:35:12 user nova-compute[74080]: INFO nova.compute.claims [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Claim successful on node user
Oct 16 07:35:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Refreshing inventories for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Updating ProviderTree inventory for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Updating inventory in ProviderTree for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Refreshing aggregate associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, aggregates: None {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Refreshing trait associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.588s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:35:12 user nova-compute[74080]: INFO nova.compute.claims [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Claim successful on node user
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:35:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:35:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:35:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:12 user nova-compute[74080]: INFO nova.virt.block_device [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Booting with volume bc0f562e-a323-42a0-b334-08353259cb27 at /dev/vda
Oct 16 07:35:13 user nova-compute[74080]: DEBUG os_brick.utils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.policy [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33b58ae309d047548ebf29684db6037e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b70039a31c47f39f7bf1b01b4e6e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8342d8e4-7744-4b2c-b4a7-80c57e436ffb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f58e97-d739-4045-9c8d-a7588c7d4fae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab98da22-2535-450d-9fc4-38c5c6264917]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d57e60-62cd-4898-ba28-a1705e553d26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:35:13 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79023b1b-9c34-4c0c-81a3-a6ed32c32922]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG os_brick.utils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updating existing volume attachment record: 4977a54d-8ae8-4aca-b81b-0290da9e6044 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.679s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:35:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.policy [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbfbcc052d274a2b85276bf7c12e8233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998dad27b18a4a15a4563815aa57cb72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:35:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Creating image(s)
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "/opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.214s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk 1073741824" returned: 0 in 0.139s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.214s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Cannot resize image /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Ensure instance console log exists: /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:14 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Successfully created port: d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:35:15 user nova-compute[74080]: DEBUG nova.network.neutron [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Successfully created port: c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating instance_info_cache with network_info: [{"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-f055134f-7d13-4ee6-9dfa-11207791a674" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Successfully updated port: d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquired lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.compute.manager [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-changed-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.compute.manager [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Refreshing instance network info cache due to event network-changed-d031f99d-6fdb-4d4f-b369-023c5f5463aa. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] Acquiring lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updating instance_info_cache with network_info: [{"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Releasing lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Instance network_info: |[{"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] Acquired lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG nova.network.neutron [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Refreshing network info cache for port d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Successfully updated port: c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquired lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:35:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.neutron [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updated VIF entry in instance network info cache for port d031f99d-6fdb-4d4f-b369-023c5f5463aa. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.neutron [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updating instance_info_cache with network_info: [{"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a8110ba5-fdd8-4666-89b6-748e6068a5a9 req-8115de94-37fd-4544-9b27-fb5494ec5063 service nova] Releasing lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.neutron [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Updating instance_info_cache with network_info: [{"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Releasing lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Instance network_info: |[{"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Start _get_guest_xml network_info=[{"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:35:18 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:18 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-345377541',display_name='tempest-AttachVolumeNegativeTest-server-345377541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-345377541',id=17,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ya7+WKxXigKuDepE1OCQ5+lphKZ+w9uehXRho0CNMOU1yfyC9M6o0vfqT6OrUFWmj94iEceSJVD7CNFH847vUPpsl1eQ8YbnMYzlD55VgY1ndFxeoby5zY+zrg9jDdw==',key_name='tempest-keypair-991718862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-ay0fod50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=20599029-1071-4ef0-8e85-825634645311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c4fae00c-8441-49df-bed2-b7d61b1dac10,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fae00c-84') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'pci_devices' on Instance uuid 20599029-1071-4ef0-8e85-825634645311 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:35:18 user nova-compute[74080]:   <uuid>20599029-1071-4ef0-8e85-825634645311</uuid>
Oct 16 07:35:18 user nova-compute[74080]:   <name>instance-00000011</name>
Oct 16 07:35:18 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:35:18 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:35:18 user nova-compute[74080]:   <metadata>
Oct 16 07:35:18 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:35:18 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:35:18 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-345377541</nova:name>
Oct 16 07:35:18 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:35:18</nova:creationTime>
Oct 16 07:35:18 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:35:18 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:35:18 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:35:18 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:35:18 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:35:18 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:35:18 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:35:18 user nova-compute[74080]:       <nova:owner>
Oct 16 07:35:18 user nova-compute[74080]:         <nova:user uuid="bbfbcc052d274a2b85276bf7c12e8233">tempest-AttachVolumeNegativeTest-1751015165-project-member</nova:user>
Oct 16 07:35:18 user nova-compute[74080]:         <nova:project uuid="998dad27b18a4a15a4563815aa57cb72">tempest-AttachVolumeNegativeTest-1751015165</nova:project>
Oct 16 07:35:18 user nova-compute[74080]:       </nova:owner>
Oct 16 07:35:18 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:35:18 user nova-compute[74080]:       <nova:ports>
Oct 16 07:35:18 user nova-compute[74080]:         <nova:port uuid="c4fae00c-8441-49df-bed2-b7d61b1dac10">
Oct 16 07:35:18 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 07:35:18 user nova-compute[74080]:         </nova:port>
Oct 16 07:35:18 user nova-compute[74080]:       </nova:ports>
Oct 16 07:35:18 user nova-compute[74080]:     </nova:instance>
Oct 16 07:35:18 user nova-compute[74080]:   </metadata>
Oct 16 07:35:18 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:35:18 user nova-compute[74080]:     <system>
Oct 16 07:35:18 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:35:18 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:35:18 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:35:18 user nova-compute[74080]:       <entry name="serial">20599029-1071-4ef0-8e85-825634645311</entry>
Oct 16 07:35:18 user nova-compute[74080]:       <entry name="uuid">20599029-1071-4ef0-8e85-825634645311</entry>
Oct 16 07:35:18 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:35:18 user nova-compute[74080]:     </system>
Oct 16 07:35:18 user nova-compute[74080]:   </sysinfo>
Oct 16 07:35:18 user nova-compute[74080]:   <os>
Oct 16 07:35:18 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:35:18 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:35:18 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:35:18 user nova-compute[74080]:   </os>
Oct 16 07:35:18 user nova-compute[74080]:   <features>
Oct 16 07:35:18 user nova-compute[74080]:     <acpi/>
Oct 16 07:35:18 user nova-compute[74080]:     <apic/>
Oct 16 07:35:18 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:35:18 user nova-compute[74080]:   </features>
Oct 16 07:35:18 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:35:18 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:35:18 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:35:18 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:35:18 user nova-compute[74080]:   </clock>
Oct 16 07:35:18 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:35:18 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:35:18 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:35:18 user nova-compute[74080]:   </cpu>
Oct 16 07:35:18 user nova-compute[74080]:   <devices>
Oct 16 07:35:18 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:35:18 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:35:18 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk"/>
Oct 16 07:35:18 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:35:18 user nova-compute[74080]:     </disk>
Oct 16 07:35:18 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:35:18 user nova-compute[74080]:       <mac address="fa:16:3e:6b:7e:2c"/>
Oct 16 07:35:18 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:18 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:35:18 user nova-compute[74080]:       <target dev="tapc4fae00c-84"/>
Oct 16 07:35:18 user nova-compute[74080]:     </interface>
Oct 16 07:35:18 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:35:18 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/console.log" append="off"/>
Oct 16 07:35:18 user nova-compute[74080]:     </serial>
Oct 16 07:35:18 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:35:18 user nova-compute[74080]:     <video>
Oct 16 07:35:18 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:18 user nova-compute[74080]:     </video>
Oct 16 07:35:18 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:35:18 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:35:18 user nova-compute[74080]:     </rng>
Oct 16 07:35:18 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:35:18 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:35:18 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:35:18 user nova-compute[74080]:     </memballoon>
Oct 16 07:35:18 user nova-compute[74080]:   </devices>
Oct 16 07:35:18 user nova-compute[74080]: </domain>
Oct 16 07:35:18 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-345377541',display_name='tempest-AttachVolumeNegativeTest-server-345377541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-345377541',id=17,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ya7+WKxXigKuDepE1OCQ5+lphKZ+w9uehXRho0CNMOU1yfyC9M6o0vfqT6OrUFWmj94iEceSJVD7CNFH847vUPpsl1eQ8YbnMYzlD55VgY1ndFxeoby5zY+zrg9jDdw==',key_name='tempest-keypair-991718862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-ay0fod50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=20599029-1071-4ef0-8e85-825634645311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c4fae00c-8441-49df-bed2-b7d61b1dac10,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fae00c-84') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG os_vif [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c4fae00c-8441-49df-bed2-b7d61b1dac10,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fae00c-84') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '660639a6-b336-5b1d-9a0c-c3e37bbd871a', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4fae00c-84, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4fae00c-84, col_values=(('qos', UUID('826c7db6-dea3-4cd1-90bf-fd5dbedd6b3f')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4fae00c-84, col_values=(('external_ids', {'iface-id': 'c4fae00c-8441-49df-bed2-b7d61b1dac10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:7e:2c', 'vm-uuid': '20599029-1071-4ef0-8e85-825634645311'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:18 user nova-compute[74080]: INFO os_vif [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c4fae00c-8441-49df-bed2-b7d61b1dac10,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fae00c-84')
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No VIF found with MAC fa:16:3e:6b:7e:2c, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-changed-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Refreshing instance network info cache due to event network-changed-c4fae00c-8441-49df-bed2-b7d61b1dac10. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] Acquiring lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] Acquired lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:18 user nova-compute[74080]: DEBUG nova.network.neutron [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Refreshing network info cache for port c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:35:19 user nova-compute[74080]: DEBUG nova.network.neutron [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Updated VIF entry in instance network info cache for port c4fae00c-8441-49df-bed2-b7d61b1dac10. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:35:19 user nova-compute[74080]: DEBUG nova.network.neutron [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Updating instance_info_cache with network_info: [{"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-34f765f0-fe38-4af5-a28c-74fd53ccf598 req-58744922-7099-4f49-aa60-956b66b6b68e service nova] Releasing lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:35:20 user nova-compute[74080]: INFO nova.compute.claims [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Claim successful on node user
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:20 user nova-compute[74080]: WARNING nova.compute.manager [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received unexpected event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with vm_state building and task_state spawning.
Oct 16 07:35:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:20 user nova-compute[74080]: WARNING nova.compute.manager [req-f897ac8e-d1e4-46ff-85e4-01f29ce8fa8c req-b999c487-d813-4bd4-861b-21a5606c51a7 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received unexpected event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with vm_state building and task_state spawning.
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:21 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.policy [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf2fbffe5a5544dba338662d437d5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea8d62574f84ae6a83ee19b7b03c21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674/disk --force-share --output=json" returned: 0 in 0.445s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:35:21 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Creating image(s)
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "/opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "/opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:35:22 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 20599029-1071-4ef0-8e85-825634645311] Instance spawned successfully.
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: INFO nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Took 8.67 seconds to spawn the instance on the hypervisor.
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk 1073741824" returned: 0 in 0.066s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Successfully created port: 5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: INFO nova.compute.manager [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Took 10.80 seconds to build instance.
Oct 16 07:35:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9812cddb-9d68-4baa-85e6-15de8504c27b tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.943s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Cannot resize image /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Ensure instance console log exists: /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Successfully updated port: 5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquired lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Received event network-changed-5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Refreshing instance network info cache due to event network-changed-5391b3b8-77e6-4f76-aa53-108a47512757. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] Acquiring lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7837MB free_disk=25.562450408935547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f055134f-7d13-4ee6-9dfa-11207791a674 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 87991349-e339-4fcf-b4ef-52936a931511 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1960a20e-bc74-4d96-8c0f-4f41e47ea82e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 20599029-1071-4ef0-8e85-825634645311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Updating instance_info_cache with network_info: [{"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Releasing lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Instance network_info: |[{"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] Acquired lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Refreshing network info cache for port 5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Start _get_guest_xml network_info=[{"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:35:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50511365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50511365',id=19,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-188fnxw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:22Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=4d6118bf-0075-4d1c-ad47-c151722a4ad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5c:b3,bridge_name='br-int',has_traffic_filtering=True,id=5391b3b8-77e6-4f76-aa53-108a47512757,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5391b3b8-77') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.objects.instance [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d6118bf-0075-4d1c-ad47-c151722a4ad0 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:35:23 user nova-compute[74080]:   <uuid>4d6118bf-0075-4d1c-ad47-c151722a4ad0</uuid>
Oct 16 07:35:23 user nova-compute[74080]:   <name>instance-00000013</name>
Oct 16 07:35:23 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:35:23 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:35:23 user nova-compute[74080]:   <metadata>
Oct 16 07:35:23 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:35:23 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:35:23 user nova-compute[74080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-50511365</nova:name>
Oct 16 07:35:23 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:35:23</nova:creationTime>
Oct 16 07:35:23 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:35:23 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:35:23 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:35:23 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:35:23 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:35:23 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:35:23 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:35:23 user nova-compute[74080]:       <nova:owner>
Oct 16 07:35:23 user nova-compute[74080]:         <nova:user uuid="bf2fbffe5a5544dba338662d437d5ee2">tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member</nova:user>
Oct 16 07:35:23 user nova-compute[74080]:         <nova:project uuid="cea8d62574f84ae6a83ee19b7b03c21a">tempest-ServerBootFromVolumeStableRescueTest-1639701158</nova:project>
Oct 16 07:35:23 user nova-compute[74080]:       </nova:owner>
Oct 16 07:35:23 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:35:23 user nova-compute[74080]:       <nova:ports>
Oct 16 07:35:23 user nova-compute[74080]:         <nova:port uuid="5391b3b8-77e6-4f76-aa53-108a47512757">
Oct 16 07:35:23 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:35:23 user nova-compute[74080]:         </nova:port>
Oct 16 07:35:23 user nova-compute[74080]:       </nova:ports>
Oct 16 07:35:23 user nova-compute[74080]:     </nova:instance>
Oct 16 07:35:23 user nova-compute[74080]:   </metadata>
Oct 16 07:35:23 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:35:23 user nova-compute[74080]:     <system>
Oct 16 07:35:23 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:35:23 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:35:23 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:35:23 user nova-compute[74080]:       <entry name="serial">4d6118bf-0075-4d1c-ad47-c151722a4ad0</entry>
Oct 16 07:35:23 user nova-compute[74080]:       <entry name="uuid">4d6118bf-0075-4d1c-ad47-c151722a4ad0</entry>
Oct 16 07:35:23 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:35:23 user nova-compute[74080]:     </system>
Oct 16 07:35:23 user nova-compute[74080]:   </sysinfo>
Oct 16 07:35:23 user nova-compute[74080]:   <os>
Oct 16 07:35:23 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:35:23 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:35:23 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:35:23 user nova-compute[74080]:   </os>
Oct 16 07:35:23 user nova-compute[74080]:   <features>
Oct 16 07:35:23 user nova-compute[74080]:     <acpi/>
Oct 16 07:35:23 user nova-compute[74080]:     <apic/>
Oct 16 07:35:23 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:35:23 user nova-compute[74080]:   </features>
Oct 16 07:35:23 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:35:23 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:35:23 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:35:23 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:35:23 user nova-compute[74080]:   </clock>
Oct 16 07:35:23 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:35:23 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:35:23 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:35:23 user nova-compute[74080]:   </cpu>
Oct 16 07:35:23 user nova-compute[74080]:   <devices>
Oct 16 07:35:23 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:35:23 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:35:23 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk"/>
Oct 16 07:35:23 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:35:23 user nova-compute[74080]:     </disk>
Oct 16 07:35:23 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:35:23 user nova-compute[74080]:       <mac address="fa:16:3e:1c:5c:b3"/>
Oct 16 07:35:23 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:23 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:35:23 user nova-compute[74080]:       <target dev="tap5391b3b8-77"/>
Oct 16 07:35:23 user nova-compute[74080]:     </interface>
Oct 16 07:35:23 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:35:23 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/console.log" append="off"/>
Oct 16 07:35:23 user nova-compute[74080]:     </serial>
Oct 16 07:35:23 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:35:23 user nova-compute[74080]:     <video>
Oct 16 07:35:23 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:23 user nova-compute[74080]:     </video>
Oct 16 07:35:23 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:35:23 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:35:23 user nova-compute[74080]:     </rng>
Oct 16 07:35:23 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:35:23 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:35:23 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:35:23 user nova-compute[74080]:     </memballoon>
Oct 16 07:35:23 user nova-compute[74080]:   </devices>
Oct 16 07:35:23 user nova-compute[74080]: </domain>
Oct 16 07:35:23 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-50511365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-50511365',id=19,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-188fnxw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:22Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=4d6118bf-0075-4d1c-ad47-c151722a4ad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5c:b3,bridge_name='br-int',has_traffic_filtering=True,id=5391b3b8-77e6-4f76-aa53-108a47512757,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5391b3b8-77') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG os_vif [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5c:b3,bridge_name='br-int',has_traffic_filtering=True,id=5391b3b8-77e6-4f76-aa53-108a47512757,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5391b3b8-77') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f07cd3f-ca8e-5a56-9aa9-a8095c395c5b', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5391b3b8-77, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5391b3b8-77, col_values=(('qos', UUID('c9835866-4259-4020-a079-e3ad7e469706')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5391b3b8-77, col_values=(('external_ids', {'iface-id': '5391b3b8-77e6-4f76-aa53-108a47512757', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:5c:b3', 'vm-uuid': '4d6118bf-0075-4d1c-ad47-c151722a4ad0'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:24 user nova-compute[74080]: INFO os_vif [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5c:b3,bridge_name='br-int',has_traffic_filtering=True,id=5391b3b8-77e6-4f76-aa53-108a47512757,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5391b3b8-77')
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No VIF found with MAC fa:16:3e:1c:5c:b3, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:35:24 user nova-compute[74080]: INFO nova.compute.manager [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] [instance: 87991349-e339-4fcf-b4ef-52936a931511] Took 19.12 seconds to detach 3 volumes for instance.
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.020s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:24 user nova-compute[74080]: INFO nova.compute.manager [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Terminating instance
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.network.neutron [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Updated VIF entry in instance network info cache for port 5391b3b8-77e6-4f76-aa53-108a47512757. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.network.neutron [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Updating instance_info_cache with network_info: [{"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4a6413f1-c8b7-410a-87f7-f17d67fc9cdb req-a6a5c390-6bbd-4644-8e0b-835957a3d65d service nova] Releasing lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scNoyrUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:35:24 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:35:24 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:35:24 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dec24c8-ae7e-4f2d-97d7-45eb84e72f8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:35:24 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5af7699-0277-4d1b-b5dd-f5a1b7374e80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9] added
Oct 16 07:35:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.598s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.049s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[397095ef-7d79-4653-ad10-d36970070d31]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39e63a1-eee4-4ad6-a724-a5ac848db582]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scNoyrUa {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:24 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Deleted allocations for instance 87991349-e339-4fcf-b4ef-52936a931511
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scNoyrUa" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b7181-cdc9-4b72-872a-65e5ca4676dd]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scNoyrUa'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9635cb63-bffe-4575-98d7-85fbd306e194]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[525c84e3-7011-4eba-b478-c886be3d4189]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:24 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:35:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:24 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:35:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:35:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-41b3a95e-f73a-4ad5-a932-cecc9660d03d tempest-TaggedBootDevicesTest-397809528 tempest-TaggedBootDevicesTest-397809528-project-member] Lock "87991349-e339-4fcf-b4ef-52936a931511" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 29.851s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "87991349-e339-4fcf-b4ef-52936a931511" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 23.583s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:25 user nova-compute[74080]: INFO nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 87991349-e339-4fcf-b4ef-52936a931511] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "87991349-e339-4fcf-b4ef-52936a931511" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c360eadf-af3e-40c6-b2e6-49b3d083d215]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]
Oct 16 07:35:25 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.
Oct 16 07:35:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b4cbba-2e5d-479e-8b88-e065cff1ddbe]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[50da6eb9-8e77-4a0c-8039-5888675ff778]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:25 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:35:25 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:25 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:35:25 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a56286-b198-4d03-aad0-7edde269258b]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scNoyrUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-3e2c88db-e8b0-43b5-9e8d-7465d05d47f1 req-e35fe353-a375-4671-b27c-21fd585ccf1e service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-vif-unplugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3e2c88db-e8b0-43b5-9e8d-7465d05d47f1 req-e35fe353-a375-4671-b27c-21fd585ccf1e service nova] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3e2c88db-e8b0-43b5-9e8d-7465d05d47f1 req-e35fe353-a375-4671-b27c-21fd585ccf1e service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3e2c88db-e8b0-43b5-9e8d-7465d05d47f1 req-e35fe353-a375-4671-b27c-21fd585ccf1e service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-3e2c88db-e8b0-43b5-9e8d-7465d05d47f1 req-e35fe353-a375-4671-b27c-21fd585ccf1e service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] No waiting events found dispatching network-vif-unplugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-3e2c88db-e8b0-43b5-9e8d-7465d05d47f1 req-e35fe353-a375-4671-b27c-21fd585ccf1e service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-vif-unplugged-f4208389-c89e-435b-8e7f-e34473a939b6 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:35:25 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Instance destroyed successfully.
Oct 16 07:35:25 user nova-compute[74080]: DEBUG nova.objects.instance [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lazy-loading 'resources' on Instance uuid f055134f-7d13-4ee6-9dfa-11207791a674 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1210249820',display_name='tempest-VolumesAdminNegativeTest-server-1210249820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1210249820',id=4,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCM431sxIeG1W5nsrrRP4bvADO4ODSlunmy/dbTolxODslXIeyQ3iWCAXetOVVtsKA3kaXZcLwG2kYME10XXHuqAglUZzPbJ37lkEG4EhD6kC3LSoZB3JZ6Z8MEoZXZsYw==',key_name='tempest-keypair-551139216',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:28:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c2464ccb4f24e319dadbd7d2edd64fd',ramdisk_id='',reservation_id='r-sqeogjpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1570382741',owner_user_name='tempest-VolumesAdminNegativeTest-1570382741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:28:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ebb8d2a523034e03b8bb5f09d5f720fa',uuid=f055134f-7d13-4ee6-9dfa-11207791a674,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converting VIF {"id": "f4208389-c89e-435b-8e7f-e34473a939b6", "address": "fa:16:3e:aa:99:04", "network": {"id": "f7cd0162-5715-4e50-9e28-2ed4c7405d25", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-917393706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c2464ccb4f24e319dadbd7d2edd64fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4208389-c8", "ovs_interfaceid": "f4208389-c89e-435b-8e7f-e34473a939b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:99:04,bridge_name='br-int',has_traffic_filtering=True,id=f4208389-c89e-435b-8e7f-e34473a939b6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4208389-c8') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG os_vif [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:99:04,bridge_name='br-int',has_traffic_filtering=True,id=f4208389-c89e-435b-8e7f-e34473a939b6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4208389-c8') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4208389-c8, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=461997ea-25bb-4f66-a9b9-6ffc7299ce40) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: INFO os_vif [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:99:04,bridge_name='br-int',has_traffic_filtering=True,id=f4208389-c89e-435b-8e7f-e34473a939b6,network=Network(f7cd0162-5715-4e50-9e28-2ed4c7405d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4208389-c8')
Oct 16 07:35:26 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Deleting instance files /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674_del
Oct 16 07:35:26 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Deletion of /opt/stack/data/nova/instances/f055134f-7d13-4ee6-9dfa-11207791a674_del complete
Oct 16 07:35:26 user nova-compute[74080]: INFO nova.compute.manager [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Took 1.64 seconds to destroy the instance on the hypervisor.
Oct 16 07:35:26 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26163643565386462', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163643565386462', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:35:26 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:35:26 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:35:26 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:35:26 user nova-compute[74080]:   <serial>82aa8960-04f1-4889-b389-ba67063042c9</serial>
Oct 16 07:35:26 user nova-compute[74080]: </disk>
Oct 16 07:35:26 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-1744ac59-6038-43c3-a97e-1c8ab6636f5d req-3faeece8-b798-490c-967d-546fc9e13560 service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Received event network-vif-plugged-5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1744ac59-6038-43c3-a97e-1c8ab6636f5d req-3faeece8-b798-490c-967d-546fc9e13560 service nova] Acquiring lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1744ac59-6038-43c3-a97e-1c8ab6636f5d req-3faeece8-b798-490c-967d-546fc9e13560 service nova] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1744ac59-6038-43c3-a97e-1c8ab6636f5d req-3faeece8-b798-490c-967d-546fc9e13560 service nova] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-1744ac59-6038-43c3-a97e-1c8ab6636f5d req-3faeece8-b798-490c-967d-546fc9e13560 service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] No waiting events found dispatching network-vif-plugged-5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:26 user nova-compute[74080]: WARNING nova.compute.manager [req-1744ac59-6038-43c3-a97e-1c8ab6636f5d req-3faeece8-b798-490c-967d-546fc9e13560 service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Received unexpected event network-vif-plugged-5391b3b8-77e6-4f76-aa53-108a47512757 for instance with vm_state building and task_state spawning.
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:35:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No VIF found with MAC fa:16:3e:e0:3e:55, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e2092691-7fc8-40b1-842d-7862bb3e4ca1 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.759s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-0ec89ddf-aee8-428f-8922-21c2165dcad5 req-e3926251-dfed-4693-af82-b63ad7a5b444 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0ec89ddf-aee8-428f-8922-21c2165dcad5 req-e3926251-dfed-4693-af82-b63ad7a5b444 service nova] Acquiring lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0ec89ddf-aee8-428f-8922-21c2165dcad5 req-e3926251-dfed-4693-af82-b63ad7a5b444 service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0ec89ddf-aee8-428f-8922-21c2165dcad5 req-e3926251-dfed-4693-af82-b63ad7a5b444 service nova] Lock "f055134f-7d13-4ee6-9dfa-11207791a674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-0ec89ddf-aee8-428f-8922-21c2165dcad5 req-e3926251-dfed-4693-af82-b63ad7a5b444 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] No waiting events found dispatching network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:27 user nova-compute[74080]: WARNING nova.compute.manager [req-0ec89ddf-aee8-428f-8922-21c2165dcad5 req-e3926251-dfed-4693-af82-b63ad7a5b444 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received unexpected event network-vif-plugged-f4208389-c89e-435b-8e7f-e34473a939b6 for instance with vm_state active and task_state deleting.
Oct 16 07:35:27 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Took 1.45 seconds to deallocate network for instance.
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-0bc35685-0fce-48cf-a7a6-c50bc596a2ad req-52725856-2ab9-4c7a-8df8-e7de51911d74 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Received event network-vif-deleted-f4208389-c89e-435b-8e7f-e34473a939b6 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:27 user nova-compute[74080]: INFO nova.compute.manager [req-0bc35685-0fce-48cf-a7a6-c50bc596a2ad req-52725856-2ab9-4c7a-8df8-e7de51911d74 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Neutron deleted interface f4208389-c89e-435b-8e7f-e34473a939b6; detaching it from the instance and deleting it from the info cache
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.network.neutron [req-0bc35685-0fce-48cf-a7a6-c50bc596a2ad req-52725856-2ab9-4c7a-8df8-e7de51911d74 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-0bc35685-0fce-48cf-a7a6-c50bc596a2ad req-52725856-2ab9-4c7a-8df8-e7de51911d74 service nova] [instance: f055134f-7d13-4ee6-9dfa-11207791a674] Detach interface failed, port_id=f4208389-c89e-435b-8e7f-e34473a939b6, reason: Instance f055134f-7d13-4ee6-9dfa-11207791a674 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd23b73a-f29b-4333-b627-0add81516fca tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd23b73a-f29b-4333-b627-0add81516fca tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd23b73a-f29b-4333-b627-0add81516fca tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd23b73a-f29b-4333-b627-0add81516fca tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74080) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG nova.objects.instance [None req-cd23b73a-f29b-4333-b627-0add81516fca tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:28 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Deleted allocations for instance f055134f-7d13-4ee6-9dfa-11207791a674
Oct 16 07:35:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8e473a0e-f2d9-4c2a-918a-8c2e6e0381d9 tempest-VolumesAdminNegativeTest-1570382741 tempest-VolumesAdminNegativeTest-1570382741-project-member] Lock "f055134f-7d13-4ee6-9dfa-11207791a674" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.764s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-cf279015-a83b-466d-bb4c-dc2e2eead9bd req-d6aaa2f3-ae0d-4d1b-8ab2-279c841a9b6d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Received event network-vif-plugged-5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cf279015-a83b-466d-bb4c-dc2e2eead9bd req-d6aaa2f3-ae0d-4d1b-8ab2-279c841a9b6d service nova] Acquiring lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cf279015-a83b-466d-bb4c-dc2e2eead9bd req-d6aaa2f3-ae0d-4d1b-8ab2-279c841a9b6d service nova] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cf279015-a83b-466d-bb4c-dc2e2eead9bd req-d6aaa2f3-ae0d-4d1b-8ab2-279c841a9b6d service nova] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-cf279015-a83b-466d-bb4c-dc2e2eead9bd req-d6aaa2f3-ae0d-4d1b-8ab2-279c841a9b6d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] No waiting events found dispatching network-vif-plugged-5391b3b8-77e6-4f76-aa53-108a47512757 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:28 user nova-compute[74080]: WARNING nova.compute.manager [req-cf279015-a83b-466d-bb4c-dc2e2eead9bd req-d6aaa2f3-ae0d-4d1b-8ab2-279c841a9b6d service nova] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Received unexpected event network-vif-plugged-5391b3b8-77e6-4f76-aa53-108a47512757 for instance with vm_state building and task_state spawning.
Oct 16 07:35:28 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance destroyed successfully.
Oct 16 07:35:28 user nova-compute[74080]: DEBUG nova.compute.manager [None req-cd23b73a-f29b-4333-b627-0add81516fca tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:35:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-cd23b73a-f29b-4333-b627-0add81516fca tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.935s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:35:29 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Instance spawned successfully.
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:29 user nova-compute[74080]: INFO nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Took 7.22 seconds to spawn the instance on the hypervisor.
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:35:29 user nova-compute[74080]: INFO nova.compute.manager [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Took 8.59 seconds to build instance.
Oct 16 07:35:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3c7de94a-9725-456e-a340-95c403db4196 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.699s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:29 user nova-compute[74080]: WARNING nova.compute.manager [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state stopped and task_state None.
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:29 user nova-compute[74080]: WARNING nova.compute.manager [req-70c759d1-39f3-4040-bf6e-3c96187ce9bf req-24aea29d-4b9e-43d1-9cbb-1a6930605619 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state stopped and task_state None.
Oct 16 07:35:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-changed-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Refreshing instance network info cache due to event network-changed-c792e524-2ccb-4033-9db1-56ccf22a11be. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:35:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] Acquiring lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] Acquired lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:37 user nova-compute[74080]: DEBUG nova.network.neutron [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Refreshing network info cache for port c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:35:38 user nova-compute[74080]: DEBUG nova.network.neutron [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updated VIF entry in instance network info cache for port c792e524-2ccb-4033-9db1-56ccf22a11be. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:35:38 user nova-compute[74080]: DEBUG nova.network.neutron [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updating instance_info_cache with network_info: [{"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7ec5db07-6fea-48bc-b96f-17656fd8e7e1 req-8997690c-761f-47cd-8918-fe167d4b3751 service nova] Releasing lock "refresh_cache-1960a20e-bc74-4d96-8c0f-4f41e47ea82e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:39 user nova-compute[74080]: INFO nova.compute.manager [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Rebuilding instance
Oct 16 07:35:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-ac812588-1972-44f2-9a4a-4d9d725861ec req-809b0ab6-458e-40bb-ba63-96fa9b35452a service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-unplugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ac812588-1972-44f2-9a4a-4d9d725861ec req-809b0ab6-458e-40bb-ba63-96fa9b35452a service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ac812588-1972-44f2-9a4a-4d9d725861ec req-809b0ab6-458e-40bb-ba63-96fa9b35452a service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ac812588-1972-44f2-9a4a-4d9d725861ec req-809b0ab6-458e-40bb-ba63-96fa9b35452a service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-ac812588-1972-44f2-9a4a-4d9d725861ec req-809b0ab6-458e-40bb-ba63-96fa9b35452a service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-unplugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:39 user nova-compute[74080]: WARNING nova.compute.manager [req-ac812588-1972-44f2-9a4a-4d9d725861ec req-809b0ab6-458e-40bb-ba63-96fa9b35452a service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received unexpected event network-vif-unplugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with vm_state active and task_state rebuilding.
Oct 16 07:35:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance destroyed successfully.
Oct 16 07:35:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance destroyed successfully.
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1579119968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-687647800',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWg4YdQesoVuM/WrNXQW+kIdOFM6JSECUZzdALHq04v1FQWToM3QSyK/Ofd2DdWjWBU+/BJZzQGaQqaBqWByl2HZtKVlxS1w7xeSk0FxNaH8bNrQPLeM2SYusDF4mUtQ==',key_name='tempest-keypair-1129031097',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d056746711e9427e84183bb13bdf386b',ramdisk_id='',reservation_id='r-1w49mmmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-200374556',owner_user_name='tempest-ServerActionsV293TestJSON-200374556-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ce6a7e3fc4f1c8edab7788688213a',uuid=1960a20e-bc74-4d96-8c0f-4f41e47ea82e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converting VIF {"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_vif [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc792e524-2c, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43bc0499-9587-4c37-9d87-ae82900cf71f) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:40 user nova-compute[74080]: INFO os_vif [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c')
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:35:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599e6fb-7e4e-4508-85b7-91f6726572d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:35:40 user nova-compute[74080]: No targets found.
Oct 16 07:35:40 user nova-compute[74080]: iSNS:
Oct 16 07:35:40 user nova-compute[74080]: No targets found.
Oct 16 07:35:40 user nova-compute[74080]: STATIC:
Oct 16 07:35:40 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:35:40 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:35:40 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:35:40 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:35:40 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:35:40 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:35:40 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:35:40 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:35:40 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:35:40 user nova-compute[74080]: FIRMWARE:
Oct 16 07:35:40 user nova-compute[74080]: No targets found.
Oct 16 07:35:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:35:40 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:35:40 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec93d98a-d95c-4365-9ad4-1c29eaf13a0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4afb4a6-6a1e-47c9-87d3-1af4c6462182]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:35:40 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:35:40 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7cc262dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf'): ({'sdf'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Removing single pathed devices sdf {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d7350-550a-4d5a-bf83-ef48d7a075b7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[83124e40-1c38-4382-842f-be92e94bd7ec]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Flushing IO for device /dev/sdf {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d871d8-2ae2-4f41-8bff-5b8e7f39c0b8]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.085s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e554dd40-6103-47e9-ad2e-58432708266a]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26436666663623561', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4cf1190c', '/dev/disk/by-id/scsi-1SCST_BIO4cf1190c-d6ffcb5a57cc02d8') {{(pid=85089) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[059926b7-2b90-44a5-8c58-e09e3b8df160]: (4, None) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a6c0d8-2a5e-4efd-aecb-0fd183ba4bf4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:35:40 user nova-compute[74080]: INFO nova.compute.claims [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Claim successful on node user
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[69115ca0-332f-496d-8eb9-742a6cfe1ed7]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]
Oct 16 07:35:40 user nova-compute[74080]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.
Oct 16 07:35:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[197cd077-009c-4155-a34a-10551ea4eb93]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] <== disconnect_volume: return (411ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:35:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Deleting instance files /opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e_del
Oct 16 07:35:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Deletion of /opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e_del complete
Oct 16 07:35:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:40 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 1960a20e-bc74-4d96-8c0f-4f41e47ea82e could not be found.
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:35:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[115c573d-9309-43ca-b361-6e0496ed684a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:35:40 user nova-compute[74080]: No targets found.
Oct 16 07:35:40 user nova-compute[74080]: iSNS:
Oct 16 07:35:40 user nova-compute[74080]: No targets found.
Oct 16 07:35:40 user nova-compute[74080]: STATIC:
Oct 16 07:35:40 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:35:40 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:35:40 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:35:40 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:35:40 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:35:40 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:35:40 user nova-compute[74080]: FIRMWARE:
Oct 16 07:35:40 user nova-compute[74080]: No targets found.
Oct 16 07:35:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:35:40 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:35:40 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ee87f8-a916-4c44-8d00-b79c1bfd4763]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25bc74b-2975-4d17-8a56-4b4e387761d0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac258700>, {}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Disconnecting from: [] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] <== disconnect_volume: return (81ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:40 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG nova.network.neutron [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:35:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:35:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG nova.policy [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69562ed193c74ec0815d41cbe9b662c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbb580495c34728bb3d06e92842737d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:35:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Creating image(s)
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "/opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "/opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "/opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk 1073741824" returned: 0 in 0.072s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-ca82109f-a182-4ec1-a439-44afdb0c441f req-f5577bc3-e582-4cc9-89fe-f17fe7d6db3c service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ca82109f-a182-4ec1-a439-44afdb0c441f req-f5577bc3-e582-4cc9-89fe-f17fe7d6db3c service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ca82109f-a182-4ec1-a439-44afdb0c441f req-f5577bc3-e582-4cc9-89fe-f17fe7d6db3c service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ca82109f-a182-4ec1-a439-44afdb0c441f req-f5577bc3-e582-4cc9-89fe-f17fe7d6db3c service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-ca82109f-a182-4ec1-a439-44afdb0c441f req-f5577bc3-e582-4cc9-89fe-f17fe7d6db3c service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:42 user nova-compute[74080]: WARNING nova.compute.manager [req-ca82109f-a182-4ec1-a439-44afdb0c441f req-f5577bc3-e582-4cc9-89fe-f17fe7d6db3c service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received unexpected event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with vm_state active and task_state rebuilding.
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Preparing to wait for external event volume-reimaged-7b4ab4cc-fc59-408a-a868-cfbdef70a3cf {{(pid=74080) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Cannot resize image /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Ensure instance console log exists: /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG nova.network.neutron [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Successfully created port: 20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:35:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Successfully updated port: 20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquired lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-changed-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Refreshing instance network info cache due to event network-changed-20e11b12-f03f-4785-b0ed-e879fed63fe1. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] Acquiring lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.neutron [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updating instance_info_cache with network_info: [{"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Releasing lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Instance network_info: |[{"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] Acquired lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.neutron [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Refreshing network info cache for port 20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Start _get_guest_xml network_info=[{"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:35:43 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:43 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-587662913',display_name='tempest-VolumesSnapshotTestJSON-instance-587662913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-587662913',id=20,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMPVnDaMpYPuTOtyR6/LWkxarJjeBPUS0zEJjk/wk5s9R2D/j8jslDl/J7ajJpUgdcyep1wwiYm/ZNPO/5NsBAFVuY6VN31IWpE+nIeTQ0gKcRXsfitMHoLSHpu76zckQ==',key_name='tempest-keypair-316658904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dbb580495c34728bb3d06e92842737d',ramdisk_id='',reservation_id='r-3p7w0w0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389413629',owner_user_name='tempest-VolumesSnapshotTestJSON-389413629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69562ed193c74ec0815d41cbe9b662c1',uuid=7dbb5b31-5a8a-474f-91ae-642a9019fd10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converting VIF {"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:29:4d,bridge_name='br-int',has_traffic_filtering=True,id=20e11b12-f03f-4785-b0ed-e879fed63fe1,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e11b12-f0') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.objects.instance [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dbb5b31-5a8a-474f-91ae-642a9019fd10 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:35:43 user nova-compute[74080]:   <uuid>7dbb5b31-5a8a-474f-91ae-642a9019fd10</uuid>
Oct 16 07:35:43 user nova-compute[74080]:   <name>instance-00000014</name>
Oct 16 07:35:43 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:35:43 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:35:43 user nova-compute[74080]:   <metadata>
Oct 16 07:35:43 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:35:43 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:35:43 user nova-compute[74080]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-587662913</nova:name>
Oct 16 07:35:43 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:35:43</nova:creationTime>
Oct 16 07:35:43 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:35:43 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:35:43 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:35:43 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:35:43 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:35:43 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:35:43 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:35:43 user nova-compute[74080]:       <nova:owner>
Oct 16 07:35:43 user nova-compute[74080]:         <nova:user uuid="69562ed193c74ec0815d41cbe9b662c1">tempest-VolumesSnapshotTestJSON-389413629-project-member</nova:user>
Oct 16 07:35:43 user nova-compute[74080]:         <nova:project uuid="7dbb580495c34728bb3d06e92842737d">tempest-VolumesSnapshotTestJSON-389413629</nova:project>
Oct 16 07:35:43 user nova-compute[74080]:       </nova:owner>
Oct 16 07:35:43 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:35:43 user nova-compute[74080]:       <nova:ports>
Oct 16 07:35:43 user nova-compute[74080]:         <nova:port uuid="20e11b12-f03f-4785-b0ed-e879fed63fe1">
Oct 16 07:35:43 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 07:35:43 user nova-compute[74080]:         </nova:port>
Oct 16 07:35:43 user nova-compute[74080]:       </nova:ports>
Oct 16 07:35:43 user nova-compute[74080]:     </nova:instance>
Oct 16 07:35:43 user nova-compute[74080]:   </metadata>
Oct 16 07:35:43 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:35:43 user nova-compute[74080]:     <system>
Oct 16 07:35:43 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:35:43 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:35:43 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:35:43 user nova-compute[74080]:       <entry name="serial">7dbb5b31-5a8a-474f-91ae-642a9019fd10</entry>
Oct 16 07:35:43 user nova-compute[74080]:       <entry name="uuid">7dbb5b31-5a8a-474f-91ae-642a9019fd10</entry>
Oct 16 07:35:43 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:35:43 user nova-compute[74080]:     </system>
Oct 16 07:35:43 user nova-compute[74080]:   </sysinfo>
Oct 16 07:35:43 user nova-compute[74080]:   <os>
Oct 16 07:35:43 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:35:43 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:35:43 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:35:43 user nova-compute[74080]:   </os>
Oct 16 07:35:43 user nova-compute[74080]:   <features>
Oct 16 07:35:43 user nova-compute[74080]:     <acpi/>
Oct 16 07:35:43 user nova-compute[74080]:     <apic/>
Oct 16 07:35:43 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:35:43 user nova-compute[74080]:   </features>
Oct 16 07:35:43 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:35:43 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:35:43 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:35:43 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:35:43 user nova-compute[74080]:   </clock>
Oct 16 07:35:43 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:35:43 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:35:43 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:35:43 user nova-compute[74080]:   </cpu>
Oct 16 07:35:43 user nova-compute[74080]:   <devices>
Oct 16 07:35:43 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:35:43 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:35:43 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk"/>
Oct 16 07:35:43 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:35:43 user nova-compute[74080]:     </disk>
Oct 16 07:35:43 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:35:43 user nova-compute[74080]:       <mac address="fa:16:3e:aa:29:4d"/>
Oct 16 07:35:43 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:43 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:35:43 user nova-compute[74080]:       <target dev="tap20e11b12-f0"/>
Oct 16 07:35:43 user nova-compute[74080]:     </interface>
Oct 16 07:35:43 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:35:43 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/console.log" append="off"/>
Oct 16 07:35:43 user nova-compute[74080]:     </serial>
Oct 16 07:35:43 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:35:43 user nova-compute[74080]:     <video>
Oct 16 07:35:43 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:43 user nova-compute[74080]:     </video>
Oct 16 07:35:43 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:35:43 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:35:43 user nova-compute[74080]:     </rng>
Oct 16 07:35:43 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:35:43 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:35:43 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:35:43 user nova-compute[74080]:     </memballoon>
Oct 16 07:35:43 user nova-compute[74080]:   </devices>
Oct 16 07:35:43 user nova-compute[74080]: </domain>
Oct 16 07:35:43 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-587662913',display_name='tempest-VolumesSnapshotTestJSON-instance-587662913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-587662913',id=20,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMPVnDaMpYPuTOtyR6/LWkxarJjeBPUS0zEJjk/wk5s9R2D/j8jslDl/J7ajJpUgdcyep1wwiYm/ZNPO/5NsBAFVuY6VN31IWpE+nIeTQ0gKcRXsfitMHoLSHpu76zckQ==',key_name='tempest-keypair-316658904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dbb580495c34728bb3d06e92842737d',ramdisk_id='',reservation_id='r-3p7w0w0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389413629',owner_user_name='tempest-VolumesSnapshotTestJSON-389413629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69562ed193c74ec0815d41cbe9b662c1',uuid=7dbb5b31-5a8a-474f-91ae-642a9019fd10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converting VIF {"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:29:4d,bridge_name='br-int',has_traffic_filtering=True,id=20e11b12-f03f-4785-b0ed-e879fed63fe1,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e11b12-f0') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG os_vif [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:29:4d,bridge_name='br-int',has_traffic_filtering=True,id=20e11b12-f03f-4785-b0ed-e879fed63fe1,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e11b12-f0') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '295500a3-1348-5c05-bd35-c8c8b31498aa', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20e11b12-f0, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20e11b12-f0, col_values=(('qos', UUID('14f2033f-0dc3-4857-9274-0964ec034a15')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20e11b12-f0, col_values=(('external_ids', {'iface-id': '20e11b12-f03f-4785-b0ed-e879fed63fe1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:29:4d', 'vm-uuid': '7dbb5b31-5a8a-474f-91ae-642a9019fd10'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:43 user nova-compute[74080]: INFO os_vif [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:29:4d,bridge_name='br-int',has_traffic_filtering=True,id=20e11b12-f03f-4785-b0ed-e879fed63fe1,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e11b12-f0')
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:35:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No VIF found with MAC fa:16:3e:aa:29:4d, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:35:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updated VIF entry in instance network info cache for port 20e11b12-f03f-4785-b0ed-e879fed63fe1. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:35:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updating instance_info_cache with network_info: [{"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2ce80adc-be38-4eb9-8c1f-2aa34c653ae8 req-f3c36ec1-348e-4313-9dfa-54210602566b service nova] Releasing lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-4becc2e6-8003-4a31-8312-d96a2c1c0d94 req-9efc2b66-290b-46ee-a19f-b97dfbd2a3b1 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4becc2e6-8003-4a31-8312-d96a2c1c0d94 req-9efc2b66-290b-46ee-a19f-b97dfbd2a3b1 service nova] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4becc2e6-8003-4a31-8312-d96a2c1c0d94 req-9efc2b66-290b-46ee-a19f-b97dfbd2a3b1 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4becc2e6-8003-4a31-8312-d96a2c1c0d94 req-9efc2b66-290b-46ee-a19f-b97dfbd2a3b1 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-4becc2e6-8003-4a31-8312-d96a2c1c0d94 req-9efc2b66-290b-46ee-a19f-b97dfbd2a3b1 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] No waiting events found dispatching network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:45 user nova-compute[74080]: WARNING nova.compute.manager [req-4becc2e6-8003-4a31-8312-d96a2c1c0d94 req-9efc2b66-290b-46ee-a19f-b97dfbd2a3b1 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received unexpected event network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 for instance with vm_state building and task_state spawning.
Oct 16 07:35:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-873aab4a-4cef-4877-ab96-01b2ef2f3d5d req-bb5f59ac-9366-4334-b766-c35483aa4813 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-873aab4a-4cef-4877-ab96-01b2ef2f3d5d req-bb5f59ac-9366-4334-b766-c35483aa4813 service nova] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-873aab4a-4cef-4877-ab96-01b2ef2f3d5d req-bb5f59ac-9366-4334-b766-c35483aa4813 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-873aab4a-4cef-4877-ab96-01b2ef2f3d5d req-bb5f59ac-9366-4334-b766-c35483aa4813 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-873aab4a-4cef-4877-ab96-01b2ef2f3d5d req-bb5f59ac-9366-4334-b766-c35483aa4813 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] No waiting events found dispatching network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:47 user nova-compute[74080]: WARNING nova.compute.manager [req-873aab4a-4cef-4877-ab96-01b2ef2f3d5d req-bb5f59ac-9366-4334-b766-c35483aa4813 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received unexpected event network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 for instance with vm_state building and task_state spawning.
Oct 16 07:35:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:35:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Instance spawned successfully.
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:47 user nova-compute[74080]: INFO nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 16 07:35:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:35:47 user nova-compute[74080]: INFO nova.compute.manager [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Took 7.34 seconds to build instance.
Oct 16 07:35:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-242317b3-f195-4cb4-b598-b78cbdd4e5c1 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.502s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:35:49 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Creating image(s)
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Ensure instance console log exists: /opt/stack/data/nova/instances/e3ce6a9c-4f1f-44c0-abd6-3c490d23a720/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Start _get_guest_xml network_info=[{"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '4977a54d-8ae8-4aca-b81b-0290da9e6044', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgkLQwZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3ce6a9c-4f1f-44c0-abd6-3c490d23a720', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc0f562e-a323-42a0-b334-08353259cb27', 'serial': 'bc0f562e-a323-42a0-b334-08353259cb27'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:35:49 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:49 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgkLQwZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:35:49 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:35:49 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:35:49 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ac056-ad5f-45ff-848f-41d14fad76e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:35:49 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c028ff-5262-4743-b187-999533082622]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27] added
Oct 16 07:35:49 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[92864ecc-2509-4e26-8623-2e250c2451af]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c2821-0a9f-4eaa-82ae-b03b2a12f34c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgkLQwZO {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgkLQwZO" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a0a0c3-bf9c-48ff-aca4-1b7416053efe]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lgkLQwZO'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4d4a18-1c9e-4c0c-a10a-f9081e6e003e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a261c-e15b-4136-8d43-33ca1861976a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:49 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:49 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:49 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:49 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:35:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --login" returned: 0 in 1.077s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47b1648-c9e1-4fa0-a652-2fe97ad297cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260]
Oct 16 07:35:50 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260] successful.
Oct 16 07:35:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ae5a6c-0c2c-42ba-976a-1e822faf899e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c577719f-72de-499a-baf0-09f876daf885]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:50 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:50 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:35:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:35:50 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:35:50 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:35:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.325s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4742b7-e257-41c5-b3e8-ddf6094ac37d]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:35:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Received event network-changed-e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Refreshing instance network info cache due to event network-changed-e6a36ae1-ea7b-4e90-b70d-424902807b64. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] Acquiring lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] Acquired lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Refreshing network info cache for port e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgkLQwZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.361s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== connect_volume: return (2362ms) {'type': 'block', 'scsi_wwn': '23432386536363738', 'path': '/dev/sdc'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432386536363738', 'path': '/dev/sdc'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updated VIF entry in instance network info cache for port e6a36ae1-ea7b-4e90-b70d-424902807b64. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.network.neutron [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updating instance_info_cache with network_info: [{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099651142',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099651142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099651142',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTWN2A16k7Ru/tPKCuVHOXXo+Z7HzJvAzLv9fvSEYYdoo5hEzaed8ob3Zvx8Y0FOWPCz3ad+0OH5rq4gnJfIMZYYEQk8hxoD3k0Ql0rpRzWTlJChX6p/puoAIL50dYpEA==',key_name='tempest-keypair-756091481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-k17unw70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33b58ae309d047548ebf29684db6037e',uuid=e3ce6a9c-4f1f-44c0-abd6-3c490d23a720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:ca,bridge_name='br-int',has_traffic_filtering=True,id=d031f99d-6fdb-4d4f-b369-023c5f5463aa,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031f99d-6f') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.objects.instance [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'pci_devices' on Instance uuid e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-51724b04-48b8-4afd-b243-109c627f98ea req-5e96885e-537b-45d7-a09b-28e39263233f service nova] Releasing lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:35:51 user nova-compute[74080]:   <uuid>e3ce6a9c-4f1f-44c0-abd6-3c490d23a720</uuid>
Oct 16 07:35:51 user nova-compute[74080]:   <name>instance-00000012</name>
Oct 16 07:35:51 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:35:51 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:35:51 user nova-compute[74080]:   <metadata>
Oct 16 07:35:51 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:35:51 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:35:51 user nova-compute[74080]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1099651142</nova:name>
Oct 16 07:35:51 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:35:49</nova:creationTime>
Oct 16 07:35:51 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:35:51 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:35:51 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:35:51 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:35:51 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:35:51 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:35:51 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:35:51 user nova-compute[74080]:       <nova:owner>
Oct 16 07:35:51 user nova-compute[74080]:         <nova:user uuid="33b58ae309d047548ebf29684db6037e">tempest-TestVolumeBootPattern-959199453-project-member</nova:user>
Oct 16 07:35:51 user nova-compute[74080]:         <nova:project uuid="c8b70039a31c47f39f7bf1b01b4e6e79">tempest-TestVolumeBootPattern-959199453</nova:project>
Oct 16 07:35:51 user nova-compute[74080]:       </nova:owner>
Oct 16 07:35:51 user nova-compute[74080]:       <nova:ports>
Oct 16 07:35:51 user nova-compute[74080]:         <nova:port uuid="d031f99d-6fdb-4d4f-b369-023c5f5463aa">
Oct 16 07:35:51 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 07:35:51 user nova-compute[74080]:         </nova:port>
Oct 16 07:35:51 user nova-compute[74080]:       </nova:ports>
Oct 16 07:35:51 user nova-compute[74080]:     </nova:instance>
Oct 16 07:35:51 user nova-compute[74080]:   </metadata>
Oct 16 07:35:51 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:35:51 user nova-compute[74080]:     <system>
Oct 16 07:35:51 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:35:51 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:35:51 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:35:51 user nova-compute[74080]:       <entry name="serial">e3ce6a9c-4f1f-44c0-abd6-3c490d23a720</entry>
Oct 16 07:35:51 user nova-compute[74080]:       <entry name="uuid">e3ce6a9c-4f1f-44c0-abd6-3c490d23a720</entry>
Oct 16 07:35:51 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:35:51 user nova-compute[74080]:     </system>
Oct 16 07:35:51 user nova-compute[74080]:   </sysinfo>
Oct 16 07:35:51 user nova-compute[74080]:   <os>
Oct 16 07:35:51 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:35:51 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:35:51 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:35:51 user nova-compute[74080]:   </os>
Oct 16 07:35:51 user nova-compute[74080]:   <features>
Oct 16 07:35:51 user nova-compute[74080]:     <acpi/>
Oct 16 07:35:51 user nova-compute[74080]:     <apic/>
Oct 16 07:35:51 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:35:51 user nova-compute[74080]:   </features>
Oct 16 07:35:51 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:35:51 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:35:51 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:35:51 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:35:51 user nova-compute[74080]:   </clock>
Oct 16 07:35:51 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:35:51 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:35:51 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:35:51 user nova-compute[74080]:   </cpu>
Oct 16 07:35:51 user nova-compute[74080]:   <devices>
Oct 16 07:35:51 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:35:51 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:35:51 user nova-compute[74080]:       <source dev="/dev/sdc"/>
Oct 16 07:35:51 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:35:51 user nova-compute[74080]:       <serial>bc0f562e-a323-42a0-b334-08353259cb27</serial>
Oct 16 07:35:51 user nova-compute[74080]:     </disk>
Oct 16 07:35:51 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:35:51 user nova-compute[74080]:       <mac address="fa:16:3e:9e:a1:ca"/>
Oct 16 07:35:51 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:51 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:35:51 user nova-compute[74080]:       <target dev="tapd031f99d-6f"/>
Oct 16 07:35:51 user nova-compute[74080]:     </interface>
Oct 16 07:35:51 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:35:51 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/e3ce6a9c-4f1f-44c0-abd6-3c490d23a720/console.log" append="off"/>
Oct 16 07:35:51 user nova-compute[74080]:     </serial>
Oct 16 07:35:51 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:35:51 user nova-compute[74080]:     <video>
Oct 16 07:35:51 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:51 user nova-compute[74080]:     </video>
Oct 16 07:35:51 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:35:51 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:35:51 user nova-compute[74080]:     </rng>
Oct 16 07:35:51 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:35:51 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:35:51 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:35:51 user nova-compute[74080]:     </memballoon>
Oct 16 07:35:51 user nova-compute[74080]:   </devices>
Oct 16 07:35:51 user nova-compute[74080]: </domain>
Oct 16 07:35:51 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099651142',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099651142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099651142',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTWN2A16k7Ru/tPKCuVHOXXo+Z7HzJvAzLv9fvSEYYdoo5hEzaed8ob3Zvx8Y0FOWPCz3ad+0OH5rq4gnJfIMZYYEQk8hxoD3k0Ql0rpRzWTlJChX6p/puoAIL50dYpEA==',key_name='tempest-keypair-756091481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-k17unw70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33b58ae309d047548ebf29684db6037e',uuid=e3ce6a9c-4f1f-44c0-abd6-3c490d23a720,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:ca,bridge_name='br-int',has_traffic_filtering=True,id=d031f99d-6fdb-4d4f-b369-023c5f5463aa,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031f99d-6f') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG os_vif [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:ca,bridge_name='br-int',has_traffic_filtering=True,id=d031f99d-6fdb-4d4f-b369-023c5f5463aa,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031f99d-6f') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fb32305-8067-56b8-9a50-f8bf9fea37bc', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd031f99d-6f, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd031f99d-6f, col_values=(('qos', UUID('8f9bca74-d89d-4a54-8dec-9de18915250c')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd031f99d-6f, col_values=(('external_ids', {'iface-id': 'd031f99d-6fdb-4d4f-b369-023c5f5463aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:a1:ca', 'vm-uuid': 'e3ce6a9c-4f1f-44c0-abd6-3c490d23a720'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:52 user nova-compute[74080]: INFO os_vif [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:a1:ca,bridge_name='br-int',has_traffic_filtering=True,id=d031f99d-6fdb-4d4f-b369-023c5f5463aa,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031f99d-6f')
Oct 16 07:35:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No VIF found with MAC fa:16:3e:9e:a1:ca, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:35:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-cb259652-9648-47c8-99bd-14a8754c1699 req-84802df7-74e1-4a82-b091-faaf978fe411 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cb259652-9648-47c8-99bd-14a8754c1699 req-84802df7-74e1-4a82-b091-faaf978fe411 service nova] Acquiring lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cb259652-9648-47c8-99bd-14a8754c1699 req-84802df7-74e1-4a82-b091-faaf978fe411 service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cb259652-9648-47c8-99bd-14a8754c1699 req-84802df7-74e1-4a82-b091-faaf978fe411 service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-cb259652-9648-47c8-99bd-14a8754c1699 req-84802df7-74e1-4a82-b091-faaf978fe411 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] No waiting events found dispatching network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:53 user nova-compute[74080]: WARNING nova.compute.manager [req-cb259652-9648-47c8-99bd-14a8754c1699 req-84802df7-74e1-4a82-b091-faaf978fe411 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received unexpected event network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa for instance with vm_state building and task_state spawning.
Oct 16 07:35:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:53 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:35:54 user nova-compute[74080]: INFO nova.compute.claims [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Claim successful on node user
Oct 16 07:35:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.network.neutron [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:35:54 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.policy [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f95746283bb04c0c98d762068eaa5a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9d95219a244140a28a733edb91013b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:35:54 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Creating image(s)
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "/opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "/opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "4b85e69f3726a289f47aa53d121282832d7d244c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "4b85e69f3726a289f47aa53d121282832d7d244c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG nova.network.neutron [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Successfully created port: 4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.part --force-share --output=json" returned: 0 in 0.237s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG nova.virt.images [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] d057cc5a-de02-43b9-aa26-f17812bdf186 was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.part /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-7b96c5cb-ff67-4d98-b790-698bd6314363 req-879c3430-dde3-463f-bfd3-0913c79c536d service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7b96c5cb-ff67-4d98-b790-698bd6314363 req-879c3430-dde3-463f-bfd3-0913c79c536d service nova] Acquiring lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7b96c5cb-ff67-4d98-b790-698bd6314363 req-879c3430-dde3-463f-bfd3-0913c79c536d service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7b96c5cb-ff67-4d98-b790-698bd6314363 req-879c3430-dde3-463f-bfd3-0913c79c536d service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-7b96c5cb-ff67-4d98-b790-698bd6314363 req-879c3430-dde3-463f-bfd3-0913c79c536d service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] No waiting events found dispatching network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:55 user nova-compute[74080]: WARNING nova.compute.manager [req-7b96c5cb-ff67-4d98-b790-698bd6314363 req-879c3430-dde3-463f-bfd3-0913c79c536d service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received unexpected event network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa for instance with vm_state building and task_state spawning.
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.part /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.converted" returned: 0 in 0.266s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "4b85e69f3726a289f47aa53d121282832d7d244c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.566s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:56 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Instance spawned successfully.
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:35:56 user nova-compute[74080]: INFO nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Took 7.01 seconds to spawn the instance on the hypervisor.
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "4b85e69f3726a289f47aa53d121282832d7d244c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "4b85e69f3726a289f47aa53d121282832d7d244c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:56 user nova-compute[74080]: INFO nova.compute.manager [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Took 44.75 seconds to build instance.
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3eedf8a0-998e-44b6-8b61-70c066491f24 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.877s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.network.neutron [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Successfully updated port: 4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.network.neutron [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing instance network info cache due to event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json" returned: 0 in 0.173s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c,backing_fmt=raw /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.network.neutron [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c,backing_fmt=raw /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk 1073741824" returned: 0 in 0.049s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "4b85e69f3726a289f47aa53d121282832d7d244c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:35:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.neutron [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance network_info: |[{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Cannot resize image /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Ensure instance console log exists: /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Start _get_guest_xml network_info=[{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:35:51Z,direct_url=<?>,disk_format='qcow2',id=d057cc5a-de02-43b9-aa26-f17812bdf186,min_disk=0,min_ram=0,name='tempest-scenario-img--758601961',owner='3c9d95219a244140a28a733edb91013b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:35:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'd057cc5a-de02-43b9-aa26-f17812bdf186'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:35:57 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:57 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:35:51Z,direct_url=<?>,disk_format='qcow2',id=d057cc5a-de02-43b9-aa26-f17812bdf186,min_disk=0,min_ram=0,name='tempest-scenario-img--758601961',owner='3c9d95219a244140a28a733edb91013b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:35:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-293706194',display_name='tempest-TestMinimumBasicScenario-server-293706194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-293706194',id=21,image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HgaFzgT16PzViw2GUVBuCQPdZZAN2aJww3qG+wrjc0AB73ZDIFZ3GmBtwMglULbpdFjnprQLUiVvJqKWNNuIihlQ3mFyqoF9NZYtc5BfEv0ZlEub7B4odRbPJ/b/ocQ==',key_name='tempest-TestMinimumBasicScenario-871128063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-bi7weth5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:55Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=d2f1f6a7-9bf5-4542-8408-d634e25bbd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.objects.instance [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'pci_devices' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:35:57 user nova-compute[74080]:   <uuid>d2f1f6a7-9bf5-4542-8408-d634e25bbd66</uuid>
Oct 16 07:35:57 user nova-compute[74080]:   <name>instance-00000015</name>
Oct 16 07:35:57 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:35:57 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:35:57 user nova-compute[74080]:   <metadata>
Oct 16 07:35:57 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:35:57 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:35:57 user nova-compute[74080]:       <nova:name>tempest-TestMinimumBasicScenario-server-293706194</nova:name>
Oct 16 07:35:57 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:35:57</nova:creationTime>
Oct 16 07:35:57 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:35:57 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:35:57 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:35:57 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:35:57 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:35:57 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:35:57 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:35:57 user nova-compute[74080]:       <nova:owner>
Oct 16 07:35:57 user nova-compute[74080]:         <nova:user uuid="f95746283bb04c0c98d762068eaa5a24">tempest-TestMinimumBasicScenario-1785188875-project-member</nova:user>
Oct 16 07:35:57 user nova-compute[74080]:         <nova:project uuid="3c9d95219a244140a28a733edb91013b">tempest-TestMinimumBasicScenario-1785188875</nova:project>
Oct 16 07:35:57 user nova-compute[74080]:       </nova:owner>
Oct 16 07:35:57 user nova-compute[74080]:       <nova:root type="image" uuid="d057cc5a-de02-43b9-aa26-f17812bdf186"/>
Oct 16 07:35:57 user nova-compute[74080]:       <nova:ports>
Oct 16 07:35:57 user nova-compute[74080]:         <nova:port uuid="4255ae13-23f2-4c25-b194-9c4fc4ed9342">
Oct 16 07:35:57 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:35:57 user nova-compute[74080]:         </nova:port>
Oct 16 07:35:57 user nova-compute[74080]:       </nova:ports>
Oct 16 07:35:57 user nova-compute[74080]:     </nova:instance>
Oct 16 07:35:57 user nova-compute[74080]:   </metadata>
Oct 16 07:35:57 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:35:57 user nova-compute[74080]:     <system>
Oct 16 07:35:57 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:35:57 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:35:57 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:35:57 user nova-compute[74080]:       <entry name="serial">d2f1f6a7-9bf5-4542-8408-d634e25bbd66</entry>
Oct 16 07:35:57 user nova-compute[74080]:       <entry name="uuid">d2f1f6a7-9bf5-4542-8408-d634e25bbd66</entry>
Oct 16 07:35:57 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:35:57 user nova-compute[74080]:     </system>
Oct 16 07:35:57 user nova-compute[74080]:   </sysinfo>
Oct 16 07:35:57 user nova-compute[74080]:   <os>
Oct 16 07:35:57 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:35:57 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:35:57 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:35:57 user nova-compute[74080]:   </os>
Oct 16 07:35:57 user nova-compute[74080]:   <features>
Oct 16 07:35:57 user nova-compute[74080]:     <acpi/>
Oct 16 07:35:57 user nova-compute[74080]:     <apic/>
Oct 16 07:35:57 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:35:57 user nova-compute[74080]:   </features>
Oct 16 07:35:57 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:35:57 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:35:57 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:35:57 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:35:57 user nova-compute[74080]:   </clock>
Oct 16 07:35:57 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:35:57 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:35:57 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:35:57 user nova-compute[74080]:   </cpu>
Oct 16 07:35:57 user nova-compute[74080]:   <devices>
Oct 16 07:35:57 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:35:57 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:35:57 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk"/>
Oct 16 07:35:57 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:35:57 user nova-compute[74080]:     </disk>
Oct 16 07:35:57 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:35:57 user nova-compute[74080]:       <mac address="fa:16:3e:71:ae:6a"/>
Oct 16 07:35:57 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:57 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:35:57 user nova-compute[74080]:       <target dev="tap4255ae13-23"/>
Oct 16 07:35:57 user nova-compute[74080]:     </interface>
Oct 16 07:35:57 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:35:57 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/console.log" append="off"/>
Oct 16 07:35:57 user nova-compute[74080]:     </serial>
Oct 16 07:35:57 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:35:57 user nova-compute[74080]:     <video>
Oct 16 07:35:57 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:35:57 user nova-compute[74080]:     </video>
Oct 16 07:35:57 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:35:57 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:35:57 user nova-compute[74080]:     </rng>
Oct 16 07:35:57 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:35:57 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:35:57 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:35:57 user nova-compute[74080]:     </memballoon>
Oct 16 07:35:57 user nova-compute[74080]:   </devices>
Oct 16 07:35:57 user nova-compute[74080]: </domain>
Oct 16 07:35:57 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-293706194',display_name='tempest-TestMinimumBasicScenario-server-293706194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-293706194',id=21,image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HgaFzgT16PzViw2GUVBuCQPdZZAN2aJww3qG+wrjc0AB73ZDIFZ3GmBtwMglULbpdFjnprQLUiVvJqKWNNuIihlQ3mFyqoF9NZYtc5BfEv0ZlEub7B4odRbPJ/b/ocQ==',key_name='tempest-TestMinimumBasicScenario-871128063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-bi7weth5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:55Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=d2f1f6a7-9bf5-4542-8408-d634e25bbd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG os_vif [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '937d8503-b8ad-534e-af6f-a0adda061b04', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4255ae13-23, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4255ae13-23, col_values=(('qos', UUID('42738df1-7e86-47c1-9c23-d53ad6cdb2bb')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4255ae13-23, col_values=(('external_ids', {'iface-id': '4255ae13-23f2-4c25-b194-9c4fc4ed9342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ae:6a', 'vm-uuid': 'd2f1f6a7-9bf5-4542-8408-d634e25bbd66'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: INFO os_vif [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23')
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No VIF found with MAC fa:16:3e:71:ae:6a, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updated VIF entry in instance network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-dc49819b-47d5-47d2-89e7-baf0905f8abf req-86ff110e-81bc-4743-b441-b8988f7fe6b6 service nova] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:35:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1ba2eab-8a4b-4a32-bcf6-4d0f608c5d7f req-fd854217-5e3c-4d04-88d5-62ab720d0568 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1ba2eab-8a4b-4a32-bcf6-4d0f608c5d7f req-fd854217-5e3c-4d04-88d5-62ab720d0568 service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1ba2eab-8a4b-4a32-bcf6-4d0f608c5d7f req-fd854217-5e3c-4d04-88d5-62ab720d0568 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1ba2eab-8a4b-4a32-bcf6-4d0f608c5d7f req-fd854217-5e3c-4d04-88d5-62ab720d0568 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1ba2eab-8a4b-4a32-bcf6-4d0f608c5d7f req-fd854217-5e3c-4d04-88d5-62ab720d0568 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:35:59 user nova-compute[74080]: WARNING nova.compute.manager [req-a1ba2eab-8a4b-4a32-bcf6-4d0f608c5d7f req-fd854217-5e3c-4d04-88d5-62ab720d0568 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received unexpected event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with vm_state building and task_state spawning.
Oct 16 07:35:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:35:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-b374bb28-409a-4e14-bc64-2d9b3291152c req-550b60d5-c571-49ef-a3b5-c0e7a483a0b5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b374bb28-409a-4e14-bc64-2d9b3291152c req-550b60d5-c571-49ef-a3b5-c0e7a483a0b5 service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b374bb28-409a-4e14-bc64-2d9b3291152c req-550b60d5-c571-49ef-a3b5-c0e7a483a0b5 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b374bb28-409a-4e14-bc64-2d9b3291152c req-550b60d5-c571-49ef-a3b5-c0e7a483a0b5 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-b374bb28-409a-4e14-bc64-2d9b3291152c req-550b60d5-c571-49ef-a3b5-c0e7a483a0b5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:36:01 user nova-compute[74080]: WARNING nova.compute.manager [req-b374bb28-409a-4e14-bc64-2d9b3291152c req-550b60d5-c571-49ef-a3b5-c0e7a483a0b5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received unexpected event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with vm_state building and task_state spawning.
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:36:01 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance spawned successfully.
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:01 user nova-compute[74080]: INFO nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Took 6.97 seconds to spawn the instance on the hypervisor.
Oct 16 07:36:01 user nova-compute[74080]: DEBUG nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:36:01 user nova-compute[74080]: INFO nova.compute.manager [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Took 7.88 seconds to build instance.
Oct 16 07:36:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-afee0a87-7e08-4f3c-a534-c5504311960e tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.004s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-87905552-adeb-4314-92ad-f0e7e9b1a7ba req-d90035b9-0ff5-46f5-aa25-e6d59ecc1d6b service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event volume-reimaged-7b4ab4cc-fc59-408a-a868-cfbdef70a3cf {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87905552-adeb-4314-92ad-f0e7e9b1a7ba req-d90035b9-0ff5-46f5-aa25-e6d59ecc1d6b service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87905552-adeb-4314-92ad-f0e7e9b1a7ba req-d90035b9-0ff5-46f5-aa25-e6d59ecc1d6b service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87905552-adeb-4314-92ad-f0e7e9b1a7ba req-d90035b9-0ff5-46f5-aa25-e6d59ecc1d6b service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-87905552-adeb-4314-92ad-f0e7e9b1a7ba req-d90035b9-0ff5-46f5-aa25-e6d59ecc1d6b service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Processing event volume-reimaged-7b4ab4cc-fc59-408a-a868-cfbdef70a3cf {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance event wait completed in 26 seconds for volume-reimaged {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:36:08 user nova-compute[74080]: INFO nova.virt.block_device [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Booting with volume 7b4ab4cc-fc59-408a-a868-cfbdef70a3cf at /dev/vda
Oct 16 07:36:08 user nova-compute[74080]: DEBUG os_brick.utils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcd36ad-365b-47a6-90ed-104573c27475]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c77510-9379-4657-b9a1-94a7b3e139b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc56bbe-91dc-4f16-988d-1643c4bcef14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e74f8c-5eea-4ed3-82bd-8c074b235b34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:36:08 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:36:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd257fe0-80cc-4cb1-85d5-b0ace8009de4]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG os_brick.utils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:36:08 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updating existing volume attachment record: 4ce1c491-923d-4300-b566-be2e23f65e11 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:36:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:36:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:36:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:17 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:36:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:18 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-changed-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Refreshing instance network info cache due to event network-changed-feb8314e-fc63-4c2a-ba40-139d9a84938d. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] Acquiring lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] Acquired lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG nova.network.neutron [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Refreshing network info cache for port feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG nova.objects.instance [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lazy-loading 'flavor' on Instance uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:22 user nova-compute[74080]: INFO nova.compute.manager [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Attaching volume 67ba6ec5-b121-493b-afa4-4d0716705ec0 to /dev/vdb
Oct 16 07:36:22 user nova-compute[74080]: DEBUG os_brick.utils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[755c07b6-38e3-4a93-a816-86822ebc98de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf2011c-b96a-43e0-bbc6-c24ffcb588b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c277327d-3b28-4e83-865a-f26c8b6bed46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae60527c-e170-4159-ae60-798af758b121]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:36:23 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6d2272-efc2-43ae-8098-23f965ea6c22]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG os_brick.utils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Updating existing volume attachment record: d08629b6-77eb-437b-9e1a-76bbd814c715 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Updated VIF entry in instance network info cache for port feb8314e-fc63-4c2a-ba40-139d9a84938d. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Updating instance_info_cache with network_info: [{"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-312c39a7-27a0-4fc9-bf8e-8613f0e39544 req-0d7e8491-e8c2-431b-8144-2acb1e471106 service nova] Releasing lock "refresh_cache-56ba6ebf-6771-4004-81b2-3f416ba0fb84" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:36:24 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:36:24 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7569MB free_disk=25.395709991455078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1960a20e-bc74-4d96-8c0f-4f41e47ea82e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 20599029-1071-4ef0-8e85-825634645311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:36:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:36:25 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Creating image(s)
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Ensure instance console log exists: /opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Start _get_guest_xml network_info=[{"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '4ce1c491-923d-4300-b566-be2e23f65e11', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1960a20e-bc74-4d96-8c0f-4f41e47ea82e', 'attached_at': '', 'detached_at': '', 'volume_id': '7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'serial': '7b4ab4cc-fc59-408a-a868-cfbdef70a3cf'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:36:25 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 07:36:25 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.objects.instance [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1960a20e-bc74-4d96-8c0f-4f41e47ea82e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:36:25 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:36:25 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:36:25 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[076394d0-21ef-4e73-b901-79c102cac500]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:36:25 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e190cbc5-c87e-439d-be36-a9feaab5017c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf] added
Oct 16 07:36:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edbe732-7d82-42a4-87a3-fa0758b440da]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d24318-3e0e-4caa-b390-dfcef9aab763]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWniSGuR {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWniSGuR" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80322b7-0143-4cb4-a108-a3324193ce7a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MWniSGuR'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b464f4-4353-455e-90cb-b7ba0f74ed0e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d6dd8d-7771-48c6-b591-1a8e92807357]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2195ad0e-ef62-4b98-a4d7-8d8605c409f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]
Oct 16 07:36:25 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.
Oct 16 07:36:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf59c7b-c4c4-4221-a8fd-5cc59c5d66a8]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c62e43-8a9d-4e99-99aa-e33908486d93]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:36:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:25 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:36:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c26d9-8b59-4ef3-a0da-d5b77fc90c15]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:36:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26436666663623561', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436666663623561', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1579119968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-687647800',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWg4YdQesoVuM/WrNXQW+kIdOFM6JSECUZzdALHq04v1FQWToM3QSyK/Ofd2DdWjWBU+/BJZzQGaQqaBqWByl2HZtKVlxS1w7xeSk0FxNaH8bNrQPLeM2SYusDF4mUtQ==',key_name='tempest-keypair-1129031097',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d056746711e9427e84183bb13bdf386b',ramdisk_id='',reservation_id='r-1w49mmmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-200374556',owner_user_name='tempest-ServerActionsV293TestJSON-200374556-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ce6a7e3fc4f1c8edab7788688213a',uuid=1960a20e-bc74-4d96-8c0f-4f41e47ea82e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converting VIF {"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:36:26 user nova-compute[74080]:   <uuid>1960a20e-bc74-4d96-8c0f-4f41e47ea82e</uuid>
Oct 16 07:36:26 user nova-compute[74080]:   <name>instance-0000000e</name>
Oct 16 07:36:26 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:36:26 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:36:26 user nova-compute[74080]:   <metadata>
Oct 16 07:36:26 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:36:26 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:36:26 user nova-compute[74080]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1579119968</nova:name>
Oct 16 07:36:26 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:36:25</nova:creationTime>
Oct 16 07:36:26 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:36:26 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:36:26 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:36:26 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:36:26 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:36:26 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:36:26 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:36:26 user nova-compute[74080]:       <nova:owner>
Oct 16 07:36:26 user nova-compute[74080]:         <nova:user uuid="4f9ce6a7e3fc4f1c8edab7788688213a">tempest-ServerActionsV293TestJSON-200374556-project-member</nova:user>
Oct 16 07:36:26 user nova-compute[74080]:         <nova:project uuid="d056746711e9427e84183bb13bdf386b">tempest-ServerActionsV293TestJSON-200374556</nova:project>
Oct 16 07:36:26 user nova-compute[74080]:       </nova:owner>
Oct 16 07:36:26 user nova-compute[74080]:       <nova:ports>
Oct 16 07:36:26 user nova-compute[74080]:         <nova:port uuid="c792e524-2ccb-4033-9db1-56ccf22a11be">
Oct 16 07:36:26 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 07:36:26 user nova-compute[74080]:         </nova:port>
Oct 16 07:36:26 user nova-compute[74080]:       </nova:ports>
Oct 16 07:36:26 user nova-compute[74080]:     </nova:instance>
Oct 16 07:36:26 user nova-compute[74080]:   </metadata>
Oct 16 07:36:26 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:36:26 user nova-compute[74080]:     <system>
Oct 16 07:36:26 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:36:26 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:36:26 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:36:26 user nova-compute[74080]:       <entry name="serial">1960a20e-bc74-4d96-8c0f-4f41e47ea82e</entry>
Oct 16 07:36:26 user nova-compute[74080]:       <entry name="uuid">1960a20e-bc74-4d96-8c0f-4f41e47ea82e</entry>
Oct 16 07:36:26 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:36:26 user nova-compute[74080]:     </system>
Oct 16 07:36:26 user nova-compute[74080]:   </sysinfo>
Oct 16 07:36:26 user nova-compute[74080]:   <os>
Oct 16 07:36:26 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:36:26 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:36:26 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:36:26 user nova-compute[74080]:   </os>
Oct 16 07:36:26 user nova-compute[74080]:   <features>
Oct 16 07:36:26 user nova-compute[74080]:     <acpi/>
Oct 16 07:36:26 user nova-compute[74080]:     <apic/>
Oct 16 07:36:26 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:36:26 user nova-compute[74080]:   </features>
Oct 16 07:36:26 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:36:26 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:36:26 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:36:26 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:36:26 user nova-compute[74080]:   </clock>
Oct 16 07:36:26 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:36:26 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:36:26 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:36:26 user nova-compute[74080]:   </cpu>
Oct 16 07:36:26 user nova-compute[74080]:   <devices>
Oct 16 07:36:26 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:36:26 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:36:26 user nova-compute[74080]:       <source dev="/dev/sdd"/>
Oct 16 07:36:26 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:36:26 user nova-compute[74080]:       <serial>7b4ab4cc-fc59-408a-a868-cfbdef70a3cf</serial>
Oct 16 07:36:26 user nova-compute[74080]:     </disk>
Oct 16 07:36:26 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:36:26 user nova-compute[74080]:       <mac address="fa:16:3e:9d:8d:46"/>
Oct 16 07:36:26 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:36:26 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:36:26 user nova-compute[74080]:       <target dev="tapc792e524-2c"/>
Oct 16 07:36:26 user nova-compute[74080]:     </interface>
Oct 16 07:36:26 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:36:26 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e/console.log" append="off"/>
Oct 16 07:36:26 user nova-compute[74080]:     </serial>
Oct 16 07:36:26 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:36:26 user nova-compute[74080]:     <video>
Oct 16 07:36:26 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:36:26 user nova-compute[74080]:     </video>
Oct 16 07:36:26 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:36:26 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:36:26 user nova-compute[74080]:     </rng>
Oct 16 07:36:26 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:36:26 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:36:26 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:36:26 user nova-compute[74080]:     </memballoon>
Oct 16 07:36:26 user nova-compute[74080]:   </devices>
Oct 16 07:36:26 user nova-compute[74080]: </domain>
Oct 16 07:36:26 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1579119968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-687647800',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWg4YdQesoVuM/WrNXQW+kIdOFM6JSECUZzdALHq04v1FQWToM3QSyK/Ofd2DdWjWBU+/BJZzQGaQqaBqWByl2HZtKVlxS1w7xeSk0FxNaH8bNrQPLeM2SYusDF4mUtQ==',key_name='tempest-keypair-1129031097',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:34:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d056746711e9427e84183bb13bdf386b',ramdisk_id='',reservation_id='r-1w49mmmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-200374556',owner_user_name='tempest-ServerActionsV293TestJSON-200374556-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ce6a7e3fc4f1c8edab7788688213a',uuid=1960a20e-bc74-4d96-8c0f-4f41e47ea82e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converting VIF {"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG os_vif [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a446f08-35af-50f5-a584-854b50e129d4', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc792e524-2c, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc792e524-2c, col_values=(('qos', UUID('e25b9a6c-a5fc-41b2-8186-5e7a3feca61d')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc792e524-2c, col_values=(('external_ids', {'iface-id': 'c792e524-2ccb-4033-9db1-56ccf22a11be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:8d:46', 'vm-uuid': '1960a20e-bc74-4d96-8c0f-4f41e47ea82e'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:26 user nova-compute[74080]: INFO os_vif [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c')
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:36:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] No VIF found with MAC fa:16:3e:9d:8d:46, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:36:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:36:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-5804fe55-53fe-4689-9f8d-40186049e1e2 req-96c816a8-60f3-4ca8-ae87-44579010aae4 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5804fe55-53fe-4689-9f8d-40186049e1e2 req-96c816a8-60f3-4ca8-ae87-44579010aae4 service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5804fe55-53fe-4689-9f8d-40186049e1e2 req-96c816a8-60f3-4ca8-ae87-44579010aae4 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5804fe55-53fe-4689-9f8d-40186049e1e2 req-96c816a8-60f3-4ca8-ae87-44579010aae4 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-5804fe55-53fe-4689-9f8d-40186049e1e2 req-96c816a8-60f3-4ca8-ae87-44579010aae4 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:36:28 user nova-compute[74080]: WARNING nova.compute.manager [req-5804fe55-53fe-4689-9f8d-40186049e1e2 req-96c816a8-60f3-4ca8-ae87-44579010aae4 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received unexpected event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with vm_state active and task_state rebuild_spawning.
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.compute.manager [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:36:30 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance spawned successfully.
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-53c52d5d-ecd7-4354-aebb-490b2c2d7488 req-dbf0b043-769a-45a3-a93d-e0097d7f4c28 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-53c52d5d-ecd7-4354-aebb-490b2c2d7488 req-dbf0b043-769a-45a3-a93d-e0097d7f4c28 service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-53c52d5d-ecd7-4354-aebb-490b2c2d7488 req-dbf0b043-769a-45a3-a93d-e0097d7f4c28 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-53c52d5d-ecd7-4354-aebb-490b2c2d7488 req-dbf0b043-769a-45a3-a93d-e0097d7f4c28 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-53c52d5d-ecd7-4354-aebb-490b2c2d7488 req-dbf0b043-769a-45a3-a93d-e0097d7f4c28 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:36:30 user nova-compute[74080]: WARNING nova.compute.manager [req-53c52d5d-ecd7-4354-aebb-490b2c2d7488 req-dbf0b043-769a-45a3-a93d-e0097d7f4c28 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received unexpected event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with vm_state active and task_state rebuild_spawning.
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.compute.manager [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG nova.objects.instance [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74080) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 16 07:36:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-87905552-adeb-4314-92ad-f0e7e9b1a7ba tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.103s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:37 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:36:38 user nova-compute[74080]: INFO nova.compute.claims [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Claim successful on node user
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:36:38 user nova-compute[74080]: INFO nova.compute.claims [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Claim successful on node user
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.policy [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8537fd36ebd340b09c830ab09cd16d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479d15d0c8ae430096c24dd442ce1e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:36:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Creating image(s)
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.218s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk 1073741824" returned: 0 in 0.056s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:36:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.policy [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8537fd36ebd340b09c830ab09cd16d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479d15d0c8ae430096c24dd442ce1e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.233s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Successfully created port: 0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:36:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Creating image(s)
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Cannot resize image /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Ensure instance console log exists: /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.277s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk 1073741824" returned: 0 in 0.065s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.216s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Successfully created port: ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Cannot resize image /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Ensure instance console log exists: /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Successfully updated port: 0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquired lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:36:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:36:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:36:40 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-changed-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Refreshing instance network info cache due to event network-changed-0775ad16-cbd1-4e55-ac5e-669f19cd8f73. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] Acquiring lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6b368e-59bd-47fc-80b3-ab4abce3837d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:36:40 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc841e4-de20-4a43-a100-8c69152827e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0] added
Oct 16 07:36:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f33e22c-4691-4a70-98f1-6765df193e64]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ed717-e2e2-47d9-8980-7b506afbe422]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcVsTLBp {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcVsTLBp" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd724bf4-4e85-426a-8fcb-6bffe9ba9154]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vcVsTLBp'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f24c55-0711-4e50-b245-a15b6c23eecb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2d1c16-bf3d-42ca-8b2e-c07f4a4a5e17]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:36:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:36:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec453c-171f-413a-b0c5-554306171dd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]
Oct 16 07:36:41 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.
Oct 16 07:36:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a356b98-433b-4311-90f3-c977d5c0912f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc13b139-1c60-42d6-bbc0-e04f0cec2d36]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:36:41 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:36:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ab5c4d-1ecf-40ff-a05a-61b30a831b33]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updating instance_info_cache with network_info: [{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Releasing lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance network_info: |[{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] Acquired lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.network.neutron [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Refreshing network info cache for port 0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Start _get_guest_xml network_info=[{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:36:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:36:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1586802487',display_name='tempest-ServerRescueNegativeTestJSON-server-1586802487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1586802487',id=22,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-c30rd7yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:39Z,user_data=None,user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=f0dd4404-980e-42a2-a008-05a90d9a5a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=0775ad16-cbd1-4e55-ac5e-669f19cd8f73,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0775ad16-cb') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'pci_devices' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:36:41 user nova-compute[74080]:   <uuid>f0dd4404-980e-42a2-a008-05a90d9a5a05</uuid>
Oct 16 07:36:41 user nova-compute[74080]:   <name>instance-00000016</name>
Oct 16 07:36:41 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:36:41 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:36:41 user nova-compute[74080]:   <metadata>
Oct 16 07:36:41 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:36:41 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:36:41 user nova-compute[74080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1586802487</nova:name>
Oct 16 07:36:41 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:36:41</nova:creationTime>
Oct 16 07:36:41 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:36:41 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:36:41 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:36:41 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:36:41 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:36:41 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:36:41 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:36:41 user nova-compute[74080]:       <nova:owner>
Oct 16 07:36:41 user nova-compute[74080]:         <nova:user uuid="8537fd36ebd340b09c830ab09cd16d0b">tempest-ServerRescueNegativeTestJSON-2029305131-project-member</nova:user>
Oct 16 07:36:41 user nova-compute[74080]:         <nova:project uuid="479d15d0c8ae430096c24dd442ce1e78">tempest-ServerRescueNegativeTestJSON-2029305131</nova:project>
Oct 16 07:36:41 user nova-compute[74080]:       </nova:owner>
Oct 16 07:36:41 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:36:41 user nova-compute[74080]:       <nova:ports>
Oct 16 07:36:41 user nova-compute[74080]:         <nova:port uuid="0775ad16-cbd1-4e55-ac5e-669f19cd8f73">
Oct 16 07:36:41 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 07:36:41 user nova-compute[74080]:         </nova:port>
Oct 16 07:36:41 user nova-compute[74080]:       </nova:ports>
Oct 16 07:36:41 user nova-compute[74080]:     </nova:instance>
Oct 16 07:36:41 user nova-compute[74080]:   </metadata>
Oct 16 07:36:41 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:36:41 user nova-compute[74080]:     <system>
Oct 16 07:36:41 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:36:41 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:36:41 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:36:41 user nova-compute[74080]:       <entry name="serial">f0dd4404-980e-42a2-a008-05a90d9a5a05</entry>
Oct 16 07:36:41 user nova-compute[74080]:       <entry name="uuid">f0dd4404-980e-42a2-a008-05a90d9a5a05</entry>
Oct 16 07:36:41 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:36:41 user nova-compute[74080]:     </system>
Oct 16 07:36:41 user nova-compute[74080]:   </sysinfo>
Oct 16 07:36:41 user nova-compute[74080]:   <os>
Oct 16 07:36:41 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:36:41 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:36:41 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:36:41 user nova-compute[74080]:   </os>
Oct 16 07:36:41 user nova-compute[74080]:   <features>
Oct 16 07:36:41 user nova-compute[74080]:     <acpi/>
Oct 16 07:36:41 user nova-compute[74080]:     <apic/>
Oct 16 07:36:41 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:36:41 user nova-compute[74080]:   </features>
Oct 16 07:36:41 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:36:41 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:36:41 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:36:41 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:36:41 user nova-compute[74080]:   </clock>
Oct 16 07:36:41 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:36:41 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:36:41 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:36:41 user nova-compute[74080]:   </cpu>
Oct 16 07:36:41 user nova-compute[74080]:   <devices>
Oct 16 07:36:41 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:36:41 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:36:41 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk"/>
Oct 16 07:36:41 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:36:41 user nova-compute[74080]:     </disk>
Oct 16 07:36:41 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:36:41 user nova-compute[74080]:       <mac address="fa:16:3e:eb:93:d2"/>
Oct 16 07:36:41 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:36:41 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:36:41 user nova-compute[74080]:       <target dev="tap0775ad16-cb"/>
Oct 16 07:36:41 user nova-compute[74080]:     </interface>
Oct 16 07:36:41 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:36:41 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/console.log" append="off"/>
Oct 16 07:36:41 user nova-compute[74080]:     </serial>
Oct 16 07:36:41 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:36:41 user nova-compute[74080]:     <video>
Oct 16 07:36:41 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:36:41 user nova-compute[74080]:     </video>
Oct 16 07:36:41 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:36:41 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:36:41 user nova-compute[74080]:     </rng>
Oct 16 07:36:41 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:36:41 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:36:41 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:36:41 user nova-compute[74080]:     </memballoon>
Oct 16 07:36:41 user nova-compute[74080]:   </devices>
Oct 16 07:36:41 user nova-compute[74080]: </domain>
Oct 16 07:36:41 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1586802487',display_name='tempest-ServerRescueNegativeTestJSON-server-1586802487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1586802487',id=22,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-c30rd7yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:39Z,user_data=None,user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=f0dd4404-980e-42a2-a008-05a90d9a5a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=0775ad16-cbd1-4e55-ac5e-669f19cd8f73,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0775ad16-cb') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG os_vif [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=0775ad16-cbd1-4e55-ac5e-669f19cd8f73,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0775ad16-cb') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9901222d-f44e-55a3-968a-457f23333623', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0775ad16-cb, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0775ad16-cb, col_values=(('qos', UUID('f603cb5d-8779-4cd2-9e0e-1d7a5b8d66b4')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0775ad16-cb, col_values=(('external_ids', {'iface-id': '0775ad16-cbd1-4e55-ac5e-669f19cd8f73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:93:d2', 'vm-uuid': 'f0dd4404-980e-42a2-a008-05a90d9a5a05'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:41 user nova-compute[74080]: INFO os_vif [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=0775ad16-cbd1-4e55-ac5e-669f19cd8f73,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0775ad16-cb')
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:36:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No VIF found with MAC fa:16:3e:eb:93:d2, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Successfully updated port: ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquired lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23934366366653461', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934366366653461', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.objects.instance [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lazy-loading 'flavor' on Instance uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:36:42 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:36:42 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:36:42 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:36:42 user nova-compute[74080]:   <serial>67ba6ec5-b121-493b-afa4-4d0716705ec0</serial>
Oct 16 07:36:42 user nova-compute[74080]: </disk>
Oct 16 07:36:42 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.neutron [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updated VIF entry in instance network info cache for port 0775ad16-cbd1-4e55-ac5e-669f19cd8f73. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.neutron [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updating instance_info_cache with network_info: [{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7ed4c3f-ec19-4e28-a8d1-56e1fd085f96 req-1f68044a-6070-4d5f-999a-bd6d474bd7ed service nova] Releasing lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Updating instance_info_cache with network_info: [{"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Releasing lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Instance network_info: |[{"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Start _get_guest_xml network_info=[{"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:36:42 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:36:42 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-666762875',display_name='tempest-ServerRescueNegativeTestJSON-server-666762875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-666762875',id=23,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-cj6nph7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:40Z,user_data=None,user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=8a89c84b-8e61-4290-b4e6-fe1c2bc738e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d9:87,bridge_name='br-int',has_traffic_filtering=True,id=ddb9b43e-338c-42c6-a93b-80c3a638c387,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb9b43e-33') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:36:42 user nova-compute[74080]:   <uuid>8a89c84b-8e61-4290-b4e6-fe1c2bc738e3</uuid>
Oct 16 07:36:42 user nova-compute[74080]:   <name>instance-00000017</name>
Oct 16 07:36:42 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:36:42 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:36:42 user nova-compute[74080]:   <metadata>
Oct 16 07:36:42 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:36:42 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:36:42 user nova-compute[74080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-666762875</nova:name>
Oct 16 07:36:42 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:36:42</nova:creationTime>
Oct 16 07:36:42 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:36:42 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:36:42 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:36:42 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:36:42 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:36:42 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:36:42 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:36:42 user nova-compute[74080]:       <nova:owner>
Oct 16 07:36:42 user nova-compute[74080]:         <nova:user uuid="8537fd36ebd340b09c830ab09cd16d0b">tempest-ServerRescueNegativeTestJSON-2029305131-project-member</nova:user>
Oct 16 07:36:42 user nova-compute[74080]:         <nova:project uuid="479d15d0c8ae430096c24dd442ce1e78">tempest-ServerRescueNegativeTestJSON-2029305131</nova:project>
Oct 16 07:36:42 user nova-compute[74080]:       </nova:owner>
Oct 16 07:36:42 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:36:42 user nova-compute[74080]:       <nova:ports>
Oct 16 07:36:42 user nova-compute[74080]:         <nova:port uuid="ddb9b43e-338c-42c6-a93b-80c3a638c387">
Oct 16 07:36:42 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 07:36:42 user nova-compute[74080]:         </nova:port>
Oct 16 07:36:42 user nova-compute[74080]:       </nova:ports>
Oct 16 07:36:42 user nova-compute[74080]:     </nova:instance>
Oct 16 07:36:42 user nova-compute[74080]:   </metadata>
Oct 16 07:36:42 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:36:42 user nova-compute[74080]:     <system>
Oct 16 07:36:42 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:36:42 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:36:42 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:36:42 user nova-compute[74080]:       <entry name="serial">8a89c84b-8e61-4290-b4e6-fe1c2bc738e3</entry>
Oct 16 07:36:42 user nova-compute[74080]:       <entry name="uuid">8a89c84b-8e61-4290-b4e6-fe1c2bc738e3</entry>
Oct 16 07:36:42 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:36:42 user nova-compute[74080]:     </system>
Oct 16 07:36:42 user nova-compute[74080]:   </sysinfo>
Oct 16 07:36:42 user nova-compute[74080]:   <os>
Oct 16 07:36:42 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:36:42 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:36:42 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:36:42 user nova-compute[74080]:   </os>
Oct 16 07:36:42 user nova-compute[74080]:   <features>
Oct 16 07:36:42 user nova-compute[74080]:     <acpi/>
Oct 16 07:36:42 user nova-compute[74080]:     <apic/>
Oct 16 07:36:42 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:36:42 user nova-compute[74080]:   </features>
Oct 16 07:36:42 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:36:42 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:36:42 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:36:42 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:36:42 user nova-compute[74080]:   </clock>
Oct 16 07:36:42 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:36:42 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:36:42 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:36:42 user nova-compute[74080]:   </cpu>
Oct 16 07:36:42 user nova-compute[74080]:   <devices>
Oct 16 07:36:42 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:36:42 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:36:42 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk"/>
Oct 16 07:36:42 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:36:42 user nova-compute[74080]:     </disk>
Oct 16 07:36:42 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:36:42 user nova-compute[74080]:       <mac address="fa:16:3e:1e:d9:87"/>
Oct 16 07:36:42 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:36:42 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:36:42 user nova-compute[74080]:       <target dev="tapddb9b43e-33"/>
Oct 16 07:36:42 user nova-compute[74080]:     </interface>
Oct 16 07:36:42 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:36:42 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/console.log" append="off"/>
Oct 16 07:36:42 user nova-compute[74080]:     </serial>
Oct 16 07:36:42 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:36:42 user nova-compute[74080]:     <video>
Oct 16 07:36:42 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:36:42 user nova-compute[74080]:     </video>
Oct 16 07:36:42 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:36:42 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:36:42 user nova-compute[74080]:     </rng>
Oct 16 07:36:42 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:36:42 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:36:42 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:36:42 user nova-compute[74080]:     </memballoon>
Oct 16 07:36:42 user nova-compute[74080]:   </devices>
Oct 16 07:36:42 user nova-compute[74080]: </domain>
Oct 16 07:36:42 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-666762875',display_name='tempest-ServerRescueNegativeTestJSON-server-666762875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-666762875',id=23,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-cj6nph7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:40Z,user_data=None,user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=8a89c84b-8e61-4290-b4e6-fe1c2bc738e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d9:87,bridge_name='br-int',has_traffic_filtering=True,id=ddb9b43e-338c-42c6-a93b-80c3a638c387,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb9b43e-33') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG os_vif [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d9:87,bridge_name='br-int',has_traffic_filtering=True,id=ddb9b43e-338c-42c6-a93b-80c3a638c387,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb9b43e-33') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77e17e22-4fde-5a50-84f0-4bb2ef3d8de9', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddb9b43e-33, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddb9b43e-33, col_values=(('qos', UUID('c5620fd4-7a62-4dc7-9a4c-993d15fe6c62')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddb9b43e-33, col_values=(('external_ids', {'iface-id': 'ddb9b43e-338c-42c6-a93b-80c3a638c387', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:d9:87', 'vm-uuid': '8a89c84b-8e61-4290-b4e6-fe1c2bc738e3'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:42 user nova-compute[74080]: INFO os_vif [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:d9:87,bridge_name='br-int',has_traffic_filtering=True,id=ddb9b43e-338c-42c6-a93b-80c3a638c387,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb9b43e-33')
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No VIF found with MAC fa:16:3e:1e:d9:87, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received event network-changed-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Refreshing instance network info cache due to event network-changed-ddb9b43e-338c-42c6-a93b-80c3a638c387. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] Acquiring lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] Acquired lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:36:42 user nova-compute[74080]: DEBUG nova.network.neutron [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Refreshing network info cache for port ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] No VIF found with MAC fa:16:3e:45:05:02, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG nova.network.neutron [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Updated VIF entry in instance network info cache for port ddb9b43e-338c-42c6-a93b-80c3a638c387. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG nova.network.neutron [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Updating instance_info_cache with network_info: [{"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-65293aad-9733-46fe-a0cb-dfe0bde53936 req-efd8e570-3701-49ca-85fb-82b3858dc35c service nova] Releasing lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-43f9f18d-0e40-438f-88b6-2afc5937a5f2 tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.565s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e853ecc-abc5-434d-950d-3cf15a0ab6cc req-1ee67567-a0da-4306-a794-03355e56a9d3 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e853ecc-abc5-434d-950d-3cf15a0ab6cc req-1ee67567-a0da-4306-a794-03355e56a9d3 service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e853ecc-abc5-434d-950d-3cf15a0ab6cc req-1ee67567-a0da-4306-a794-03355e56a9d3 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e853ecc-abc5-434d-950d-3cf15a0ab6cc req-1ee67567-a0da-4306-a794-03355e56a9d3 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e853ecc-abc5-434d-950d-3cf15a0ab6cc req-1ee67567-a0da-4306-a794-03355e56a9d3 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:36:44 user nova-compute[74080]: WARNING nova.compute.manager [req-6e853ecc-abc5-434d-950d-3cf15a0ab6cc req-1ee67567-a0da-4306-a794-03355e56a9d3 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state building and task_state spawning.
Oct 16 07:36:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG os_brick.utils [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a302d0-4ae2-421f-a707-28c991bd5e7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9dea7-bc5f-4f21-8027-f89fa93af38c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf69cfb-62a8-4985-90fe-6b252bc1bb0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff10f2d-c585-4aa5-9d40-422a34bc750b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:36:45 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:36:45 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73974da9-01d2-4d77-8071-99579aca3687]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG os_brick.utils [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:45 user nova-compute[74080]: INFO nova.compute.manager [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Swapping volume 67ba6ec5-b121-493b-afa4-4d0716705ec0 for 20ee8738-f2ba-4b41-918b-55740a1e79a0
Oct 16 07:36:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:36:46 user nova-compute[74080]: WARNING nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state building and task_state spawning.
Oct 16 07:36:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] No waiting events found dispatching network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:36:46 user nova-compute[74080]: WARNING nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received unexpected event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 for instance with vm_state building and task_state spawning.
Oct 16 07:36:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] No waiting events found dispatching network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:36:46 user nova-compute[74080]: WARNING nova.compute.manager [req-a1743d1b-b4bf-47a6-bbfa-06f800e2ab19 req-e8de6819-8e25-4f83-9b1f-001bfbe543c4 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received unexpected event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 for instance with vm_state building and task_state spawning.
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:36:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance spawned successfully.
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:36:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Instance spawned successfully.
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:36:47 user nova-compute[74080]: INFO nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Took 8.55 seconds to spawn the instance on the hypervisor.
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:36:47 user nova-compute[74080]: INFO nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Took 7.82 seconds to spawn the instance on the hypervisor.
Oct 16 07:36:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:36:47 user nova-compute[74080]: INFO nova.compute.manager [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Took 9.47 seconds to build instance.
Oct 16 07:36:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd8338c1-9dad-410c-b7af-348888ee21f9 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.602s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:47 user nova-compute[74080]: INFO nova.compute.manager [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Took 8.93 seconds to build instance.
Oct 16 07:36:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e43c12fa-9d8a-4f0f-8276-2ddae342fb2b tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.059s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:36:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:36:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWfcIKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56ba6ebf-6771-4004-81b2-3f416ba0fb84', 'attached_at': '', 'detached_at': '', 'volume_id': '20ee8738-f2ba-4b41-918b-55740a1e79a0', 'serial': '20ee8738-f2ba-4b41-918b-55740a1e79a0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '56ba6ebf-6771-4004-81b2-3f416ba0fb84', 'attached_at': '', 'detached_at': '', 'volume_id': '67ba6ec5-b121-493b-afa4-4d0716705ec0', 'serial'} {{(pid=74080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWfcIKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:02 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:02 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:02 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0002e4dd-5723-439e-9d43-8d5e2f385eef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:37:02 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118b405-2d1f-4d6a-8b33-620dd11687bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0] added
Oct 16 07:37:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a64389c-30fa-4eba-9ece-bcc917d114e5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e8ab7f-8aed-4b17-b5c9-11ceaa638715]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSWfcIKT {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSWfcIKT" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2235ac32-fce8-43a8-a8d3-0c875215b823]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BSWfcIKT'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a57a5c0-1666-40fe-a3f9-3e473968d9f3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b3253c-35b6-45b8-9c99-22fc4e9d1e59]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a7e564-ef53-4745-b7ad-6621f4728035]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260]
Oct 16 07:37:02 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[817b7ee2-04ac-4953-9412-5ce3ae14e9ca]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fec33f-a266-4493-b7a5-47fcf0ec4ebd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ae5dad-b415-488d-8029-d69a300205a6]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWfcIKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG nova.compute.manager [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-changed-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG nova.compute.manager [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Refreshing instance network info cache due to event network-changed-c4fae00c-8441-49df-bed2-b7d61b1dac10. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] Acquiring lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] Acquired lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Refreshing network info cache for port c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:37:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-changed-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Refreshing instance network info cache due to event network-changed-d031f99d-6fdb-4d4f-b369-023c5f5463aa. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] Acquiring lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] Acquired lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Refreshing network info cache for port d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Updated VIF entry in instance network info cache for port c4fae00c-8441-49df-bed2-b7d61b1dac10. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Updating instance_info_cache with network_info: [{"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d4c45d91-d69c-4032-a437-f59137f2b36c req-e75237cd-0128-42f9-b225-609ac320f5af service nova] Releasing lock "refresh_cache-20599029-1071-4ef0-8e85-825634645311" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26138313764616664', 'path': '/dev/sdg'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138313764616664', 'path': '/dev/sdg'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.objects.instance [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lazy-loading 'flavor' on Instance uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updated VIF entry in instance network info cache for port d031f99d-6fdb-4d4f-b369-023c5f5463aa. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updating instance_info_cache with network_info: [{"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-06568f13-252c-4c77-b487-a6bc12894b6c req-ebb95c54-7ffa-41f3-a514-11d39f180b71 service nova] Releasing lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 138412032 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 287309824 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 404750336 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 574619648 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 702545920 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 858783744 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 1007681536 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:08 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477dd8a-8c76-467e-a2c1-2c712f8b2cbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:37:08 user nova-compute[74080]: No targets found.
Oct 16 07:37:08 user nova-compute[74080]: iSNS:
Oct 16 07:37:08 user nova-compute[74080]: No targets found.
Oct 16 07:37:08 user nova-compute[74080]: STATIC:
Oct 16 07:37:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:37:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:37:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:37:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0
Oct 16 07:37:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:37:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0
Oct 16 07:37:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:08 user nova-compute[74080]: FIRMWARE:
Oct 16 07:37:08 user nova-compute[74080]: No targets found.
Oct 16 07:37:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:37:08 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:37:08 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b433b32-2ae5-485e-a798-46d8ff8af669]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[782db7a9-d2ee-4079-b7cb-97fe382b86b3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7c4253b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0'): ({'sdf'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Removing single pathed devices sdf {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea0bccf-2554-4843-b191-8ec4d6b7daaf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cabb588-5911-4bf3-85af-e88b646190be]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Flushing IO for device /dev/sdf {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d406fd-22aa-432c-91a6-ece1ce416a04]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c60ac33-763d-4baf-a573-a97d290ec239]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb877109-d836-4a59-8247-88bf3c390232]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c966e-3760-4b11-b9d9-270d3edb953b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]
Oct 16 07:37:08 user nova-compute[74080]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[439279bb-f04b-4809-bf42-c5ac8237dacf]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] <== disconnect_volume: return (338ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWfcIKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '56ba6ebf-6771-4004-81b2-3f416ba0fb84', 'attached_at': '', 'detached_at': '', 'volume_id': '20ee8738-f2ba-4b41-918b-55740a1e79a0', 'serial'} {{(pid=74080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] swap_volume: removing Cinder connection for volume 67ba6ec5-b121-493b-afa4-4d0716705ec0 {{(pid=74080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "20599029-1071-4ef0-8e85-825634645311" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG nova.objects.instance [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 20599029-1071-4ef0-8e85-825634645311 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "20599029-1071-4ef0-8e85-825634645311" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:09 user nova-compute[74080]: INFO nova.compute.manager [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Attaching volume 732be2ec-b413-4a01-93be-eec35c43ffba to /dev/vdb
Oct 16 07:37:09 user nova-compute[74080]: DEBUG os_brick.utils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ced53a-8537-4175-974d-db9a90be9b83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fdf77c-e601-4973-859d-4f3fa6248561]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f238375-40e3-4cfb-9ede-58754ec961c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e062c87f-3dc1-4b9b-b789-6afd4b22de43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:09 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b267a-225e-44e8-8757-fa8ca37c11e8]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG os_brick.utils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Updating existing volume attachment record: 96afecf3-f574-4ad3-bdac-47d0d65204aa {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] swap_volume: Updating volume 67ba6ec5-b121-493b-afa4-4d0716705ec0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BSWfcIKT", "auth_password": "6TMuzJkA1gxaLK", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "20ee8738-f2ba-4b41-918b-55740a1e79a0"}, "status": "reserved", "instance": "56ba6ebf-6771-4004-81b2-3f416ba0fb84", "attached_at": "", "detached_at": "", "volume_id": "20ee8738-f2ba-4b41-918b-55740a1e79a0", "serial": "20ee8738-f2ba-4b41-918b-55740a1e79a0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '20ee8738-f2ba-4b41-918b-55740a1e79a0', 'no_device': None, 'attachment_id': 'aa5e2f0b-16aa-4108-85f8-35cb59632b4e'} {{(pid=74080) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 16 07:37:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-9dfc91b0-c1b9-4034-b983-241c7abe1868 tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 24.514s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG os_brick.utils [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f4dce0-35e8-4281-80fb-c3b1186ae14f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[57de3f2e-3206-4e31-bcff-1e6a500403c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0458ce-029a-432b-9736-9f9dd669ef3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11d926-6cf9-4e1d-b230-ec4e346f665d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:10 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:37:10 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[09663f64-6e63-4453-924a-9d184447ef49]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:37:10 user nova-compute[74080]: DEBUG os_brick.utils [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:11 user nova-compute[74080]: INFO nova.compute.manager [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Swapping volume 20ee8738-f2ba-4b41-918b-55740a1e79a0 for 67ba6ec5-b121-493b-afa4-4d0716705ec0
Oct 16 07:37:11 user nova-compute[74080]: DEBUG nova.compute.manager [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:37:11 user nova-compute[74080]: INFO nova.compute.manager [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] instance snapshotting
Oct 16 07:37:11 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Beginning live snapshot process
Oct 16 07:37:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpirzjki1j/06baa3f177ff4ce48052fe719443fae7.delta 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpirzjki1j/06baa3f177ff4ce48052fe719443fae7.delta 1073741824" returned: 0 in 0.049s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 07:37:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:13 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 07:37:13 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:37:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpirzjki1j/06baa3f177ff4ce48052fe719443fae7.delta /opt/stack/data/nova/instances/snapshots/tmpirzjki1j/06baa3f177ff4ce48052fe719443fae7 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpirzjki1j/06baa3f177ff4ce48052fe719443fae7.delta /opt/stack/data/nova/instances/snapshots/tmpirzjki1j/06baa3f177ff4ce48052fe719443fae7" returned: 0 in 0.367s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Snapshot extracted, beginning image upload
Oct 16 07:37:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:16 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Snapshot image upload complete
Oct 16 07:37:17 user nova-compute[74080]: INFO nova.compute.manager [None req-80918fc1-3440-4d82-99e4-c9521da8dd4a tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Took 5.52 seconds to snapshot the instance on the hypervisor.
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:17 user nova-compute[74080]: INFO nova.compute.manager [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Terminating instance
Oct 16 07:37:17 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:37:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updating instance_info_cache with network_info: [{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-075874d5-9945-4793-8267-19f646230cd9 req-c89c8bcf-f1bf-4edb-a1df-6852d86c647c service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-075874d5-9945-4793-8267-19f646230cd9 req-c89c8bcf-f1bf-4edb-a1df-6852d86c647c service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-075874d5-9945-4793-8267-19f646230cd9 req-c89c8bcf-f1bf-4edb-a1df-6852d86c647c service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-075874d5-9945-4793-8267-19f646230cd9 req-c89c8bcf-f1bf-4edb-a1df-6852d86c647c service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-075874d5-9945-4793-8267-19f646230cd9 req-c89c8bcf-f1bf-4edb-a1df-6852d86c647c service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-075874d5-9945-4793-8267-19f646230cd9 req-c89c8bcf-f1bf-4edb-a1df-6852d86c647c service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-unplugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquired lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.network.neutron [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'info_cache' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.objects.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:37:18 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Instance destroyed successfully.
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lazy-loading 'resources' on Instance uuid e4b3aaca-821e-410f-83c1-7287a48c7723 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1311694320',display_name='tempest-ServerActionsTestOtherB-server-1311694320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1311694320',id=2,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPktr7+gqnGgWCpMec6ZgI/xIAwkekMTUwwnza9sITBVJiVoNRSqQgcWZQB+80rxdg7jGudAKQPX2jVKTYAbYw5bl9Z5zMY3AQe6PJDbd+j8uUX3Q7Xx2MpcFbZTcNlEw==',key_name='tempest-keypair-976512363',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:34:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0746934362024577ae7fd2846d1c2ec7',ramdisk_id='',reservation_id='r-omne406b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-885127344',owner_user_name='tempest-ServerActionsTestOtherB-885127344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bba0d0c7a2d4fb3a757aa0abdfa1a2e',uuid=e4b3aaca-821e-410f-83c1-7287a48c7723,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converting VIF {"id": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "address": "fa:16:3e:29:3d:72", "network": {"id": "8782e312-8082-4699-afd8-5d9446fa634a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-747411497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0746934362024577ae7fd2846d1c2ec7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1184cb83-61", "ovs_interfaceid": "1184cb83-61e9-4582-9ff1-1a62d2e9f4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_vif [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1184cb83-61, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d763ad2-3d4b-4c71-9c88-58d6d272f4fe) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:18 user nova-compute[74080]: INFO os_vif [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:3d:72,bridge_name='br-int',has_traffic_filtering=True,id=1184cb83-61e9-4582-9ff1-1a62d2e9f4a4,network=Network(8782e312-8082-4699-afd8-5d9446fa634a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1184cb83-61')
Oct 16 07:37:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JAKLEMOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:18 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb3bee-3aa6-490e-9c0f-ecf79b747f54]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:37:18 user nova-compute[74080]: No targets found.
Oct 16 07:37:18 user nova-compute[74080]: iSNS:
Oct 16 07:37:18 user nova-compute[74080]: No targets found.
Oct 16 07:37:18 user nova-compute[74080]: STATIC:
Oct 16 07:37:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805
Oct 16 07:37:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:37:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:37:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:37:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:18 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0
Oct 16 07:37:18 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:18 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:18 user nova-compute[74080]: FIRMWARE:
Oct 16 07:37:18 user nova-compute[74080]: No targets found.
Oct 16 07:37:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:37:18 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:37:18 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ecb743-5487-4275-9790-f238d70940b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9b1da1-d7b9-444d-a600-07ab28c86aa6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:18 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac37fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805'): ({'sde'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Removing single pathed devices sde {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.153s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4f3a42-5107-42b7-a18c-873e5c21052e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[451120e8-63df-49bf-93d5-1de5f296e3b8]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Flushing IO for device /dev/sde {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:37:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbd3d47-57e3-4cf6-8ff6-c1a948faff35]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.062s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[328c0339-9203-4f56-867a-14ce68aabb5c]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e39a10b-6052-42bc-85da-a3c6324eafdf]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba61456-5744-4d95-a456-52a19a86a77d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260]
Oct 16 07:37:19 user nova-compute[74080]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ca08889-064b-4c5b-99bf-069fe6a32805 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a52dc-a497-4263-a6a1-4bed0b227ac2]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.499s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] <== disconnect_volume: return (501ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:37:19 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Deleting instance files /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723_del
Oct 16 07:37:19 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Deletion of /opt/stack/data/nova/instances/e4b3aaca-821e-410f-83c1-7287a48c7723_del complete
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.network.neutron [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Releasing lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:19 user nova-compute[74080]: INFO nova.compute.manager [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:37:19 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance destroyed successfully.
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'resources' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.objects.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_vif [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fb90376-ac, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9146e242-93d2-4ee2-ad23-806e35c0f4fd) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:19 user nova-compute[74080]: INFO os_vif [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac')
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scNoyrUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:19 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a1e13-f371-432d-8710-0dbd1d1f907a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:37:19 user nova-compute[74080]: No targets found.
Oct 16 07:37:19 user nova-compute[74080]: iSNS:
Oct 16 07:37:19 user nova-compute[74080]: No targets found.
Oct 16 07:37:19 user nova-compute[74080]: STATIC:
Oct 16 07:37:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:37:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:37:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:37:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0
Oct 16 07:37:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:19 user nova-compute[74080]: FIRMWARE:
Oct 16 07:37:19 user nova-compute[74080]: No targets found.
Oct 16 07:37:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:37:19 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:37:19 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e14814-78a2-4027-b8c9-5379c026229f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8340c06-288e-4558-9d22-196371483b77]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:19 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:19 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:19 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:19 user nova-compute[74080]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:19 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:19 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac388a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9'): ({'sdb'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Removing single pathed devices sdb {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[20de92ce-8a34-4cc1-be41-acc2ef4c61f7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:37:19 user nova-compute[74080]: INFO nova.compute.claims [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Claim successful on node user
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf322c8-5f39-4d57-a897-d9ce4dd82ad0]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flushing IO for device /dev/sdb {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f49e7-7b0e-4e5d-b70f-0a579da0a79c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[74adaba0-a1ac-4f36-a351-43f2cb53962c]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8362401a-e196-4dc2-b750-adb7a42f296c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7063394-c385-4bb2-aa29-f18c2f1b1f2d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]
Oct 16 07:37:19 user nova-compute[74080]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70cb923-cd07-4c83-90a5-1dac680d551f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== disconnect_volume: return (347ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Start _get_guest_xml network_info=[{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'c452eb71-4658-4161-961f-0812cd8f59be', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scNoyrUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a889e1ab-9c69-4dbb-8a67-79d24bd67678', 'attached_at': '', 'detached_at': '', 'volume_id': '82aa8960-04f1-4889-b389-ba67063042c9', 'serial': '82aa8960-04f1-4889-b389-ba67063042c9'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'numa_topology' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.objects.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:37:19 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:37:19 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'vcpu_model' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.objects.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scNoyrUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:19 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:19 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:19 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260" returned: 21 in 0.122s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81e50d4-2f61-4ad1-aebc-c7dec6b5a75c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:37:19 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[447d5631-a7a4-4af3-b444-edd83d7ecd09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9] added
Oct 16 07:37:20 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd4a6c-655d-4ce0-a37a-b81b0a5a42b7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db987d6-f1f2-4903-9905-b5e77b237e35]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scNoyrUa {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scNoyrUa" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fcb4dc-bf87-46d4-aaa1-b568e5822cb6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scNoyrUa'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[751890c9-56b1-48d3-97ca-b7d90c378ac1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d50224-3f2b-42e4-9805-4ae9fe476c1c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e417db0a-8a2d-4400-ba44-45ff97ec8c73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]
Oct 16 07:37:20 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:20 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-0d14c690-4e71-4bf8-98b9-c6619e86734d req-dd1f88c9-b494-42cd-9861-ab189c94f448 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d14c690-4e71-4bf8-98b9-c6619e86734d req-dd1f88c9-b494-42cd-9861-ab189c94f448 service nova] Acquiring lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d14c690-4e71-4bf8-98b9-c6619e86734d req-dd1f88c9-b494-42cd-9861-ab189c94f448 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0d14c690-4e71-4bf8-98b9-c6619e86734d req-dd1f88c9-b494-42cd-9861-ab189c94f448 service nova] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-0d14c690-4e71-4bf8-98b9-c6619e86734d req-dd1f88c9-b494-42cd-9861-ab189c94f448 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] No waiting events found dispatching network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:37:20 user nova-compute[74080]: WARNING nova.compute.manager [req-0d14c690-4e71-4bf8-98b9-c6619e86734d req-dd1f88c9-b494-42cd-9861-ab189c94f448 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received unexpected event network-vif-plugged-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 for instance with vm_state active and task_state deleting.
Oct 16 07:37:20 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b891eee5-07f7-45eb-95e6-959c31c37e5a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beff5da-38cd-4cc4-9aab-f235e9462bba]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:20 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:37:20 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Took 1.03 seconds to deallocate network for instance.
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-1ca71239-45e9-4e94-a841-aacabefcf236 req-2ac389a3-c740-44f8-85b0-6c95094e7d04 service nova] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Received event network-vif-deleted-1184cb83-61e9-4582-9ff1-1a62d2e9f4a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7700e594-d08f-4e7a-8d06-cbfaacb93d22]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scNoyrUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:20 user nova-compute[74080]: INFO nova.virt.block_device [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Booting with volume snapshot e6eee0b9-4057-4af0-a180-0685e5383875 at /dev/vda
Oct 16 07:37:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:20 user nova-compute[74080]: DEBUG nova.policy [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33b58ae309d047548ebf29684db6037e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b70039a31c47f39f7bf1b01b4e6e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '26163643565386462', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163643565386462', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'pci_devices' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.objects.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:37:21 user nova-compute[74080]:   <uuid>a889e1ab-9c69-4dbb-8a67-79d24bd67678</uuid>
Oct 16 07:37:21 user nova-compute[74080]:   <name>instance-0000000d</name>
Oct 16 07:37:21 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:37:21 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:37:21 user nova-compute[74080]:   <metadata>
Oct 16 07:37:21 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:37:21 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:37:21 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeTestJSON-server-878526387</nova:name>
Oct 16 07:37:21 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:37:19</nova:creationTime>
Oct 16 07:37:21 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:37:21 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:37:21 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:37:21 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:37:21 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:37:21 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:37:21 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:37:21 user nova-compute[74080]:       <nova:owner>
Oct 16 07:37:21 user nova-compute[74080]:         <nova:user uuid="3e555075cd0d49f9af33eb6ebfe8d55a">tempest-AttachVolumeTestJSON-1619996160-project-member</nova:user>
Oct 16 07:37:21 user nova-compute[74080]:         <nova:project uuid="7c87d6996a3e46d19f45367113c987c9">tempest-AttachVolumeTestJSON-1619996160</nova:project>
Oct 16 07:37:21 user nova-compute[74080]:       </nova:owner>
Oct 16 07:37:21 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:37:21 user nova-compute[74080]:       <nova:ports>
Oct 16 07:37:21 user nova-compute[74080]:         <nova:port uuid="8fb90376-ac0a-4d74-8a23-29564ea728a4">
Oct 16 07:37:21 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:37:21 user nova-compute[74080]:         </nova:port>
Oct 16 07:37:21 user nova-compute[74080]:       </nova:ports>
Oct 16 07:37:21 user nova-compute[74080]:     </nova:instance>
Oct 16 07:37:21 user nova-compute[74080]:   </metadata>
Oct 16 07:37:21 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:37:21 user nova-compute[74080]:     <system>
Oct 16 07:37:21 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:37:21 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:37:21 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:37:21 user nova-compute[74080]:       <entry name="serial">a889e1ab-9c69-4dbb-8a67-79d24bd67678</entry>
Oct 16 07:37:21 user nova-compute[74080]:       <entry name="uuid">a889e1ab-9c69-4dbb-8a67-79d24bd67678</entry>
Oct 16 07:37:21 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:37:21 user nova-compute[74080]:     </system>
Oct 16 07:37:21 user nova-compute[74080]:   </sysinfo>
Oct 16 07:37:21 user nova-compute[74080]:   <os>
Oct 16 07:37:21 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:37:21 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:37:21 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:37:21 user nova-compute[74080]:   </os>
Oct 16 07:37:21 user nova-compute[74080]:   <features>
Oct 16 07:37:21 user nova-compute[74080]:     <acpi/>
Oct 16 07:37:21 user nova-compute[74080]:     <apic/>
Oct 16 07:37:21 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:37:21 user nova-compute[74080]:   </features>
Oct 16 07:37:21 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:37:21 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:37:21 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:37:21 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:37:21 user nova-compute[74080]:   </clock>
Oct 16 07:37:21 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:37:21 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:37:21 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:37:21 user nova-compute[74080]:   </cpu>
Oct 16 07:37:21 user nova-compute[74080]:   <devices>
Oct 16 07:37:21 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:37:21 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:37:21 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk"/>
Oct 16 07:37:21 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:37:21 user nova-compute[74080]:     </disk>
Oct 16 07:37:21 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:37:21 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:37:21 user nova-compute[74080]:       <source dev="/dev/sdb"/>
Oct 16 07:37:21 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:37:21 user nova-compute[74080]:       <serial>82aa8960-04f1-4889-b389-ba67063042c9</serial>
Oct 16 07:37:21 user nova-compute[74080]:     </disk>
Oct 16 07:37:21 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:37:21 user nova-compute[74080]:       <mac address="fa:16:3e:e0:3e:55"/>
Oct 16 07:37:21 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:37:21 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:37:21 user nova-compute[74080]:       <target dev="tap8fb90376-ac"/>
Oct 16 07:37:21 user nova-compute[74080]:     </interface>
Oct 16 07:37:21 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:37:21 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/console.log" append="off"/>
Oct 16 07:37:21 user nova-compute[74080]:     </serial>
Oct 16 07:37:21 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:37:21 user nova-compute[74080]:     <video>
Oct 16 07:37:21 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:37:21 user nova-compute[74080]:     </video>
Oct 16 07:37:21 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:37:21 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:37:21 user nova-compute[74080]:     </rng>
Oct 16 07:37:21 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:37:21 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:37:21 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:37:21 user nova-compute[74080]:     </memballoon>
Oct 16 07:37:21 user nova-compute[74080]:   </devices>
Oct 16 07:37:21 user nova-compute[74080]: </domain>
Oct 16 07:37:21 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Successfully created port: 1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'trusted_certs' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG nova.objects.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:37:21 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.170s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Cannot resize image /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.objects.instance [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'migration_context' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.objects.base [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG os_vif [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50b2ca38-57a2-507b-8601-44fb2772180c', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Successfully updated port: 1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fb90376-ac, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fb90376-ac, col_values=(('qos', UUID('dc6c4774-d760-426f-800b-4db9cf250528')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fb90376-ac, col_values=(('external_ids', {'iface-id': '8fb90376-ac0a-4d74-8a23-29564ea728a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:3e:55', 'vm-uuid': 'a889e1ab-9c69-4dbb-8a67-79d24bd67678'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquired lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:22 user nova-compute[74080]: INFO os_vif [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac')
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-changed-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Refreshing instance network info cache due to event network-changed-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] Acquiring lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updating instance_info_cache with network_info: [{"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Releasing lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Instance network_info: |[{"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] Acquired lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.neutron [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Refreshing network info cache for port 1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.neutron [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updated VIF entry in instance network info cache for port 1dadda9b-6dc1-433f-85c4-df2e0d7dcc41. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG nova.network.neutron [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updating instance_info_cache with network_info: [{"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b3c8e75c-8ff6-49a8-8932-7855ab1a3017 req-67f460f6-5dd5-4c4e-80ea-273cb9a21b31 service nova] Releasing lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-59ed8b60-818c-4b71-ae96-1f147dace5bc req-4118838b-8ee4-4c7e-8a3e-50b7f4556ee3 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-59ed8b60-818c-4b71-ae96-1f147dace5bc req-4118838b-8ee4-4c7e-8a3e-50b7f4556ee3 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-59ed8b60-818c-4b71-ae96-1f147dace5bc req-4118838b-8ee4-4c7e-8a3e-50b7f4556ee3 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-59ed8b60-818c-4b71-ae96-1f147dace5bc req-4118838b-8ee4-4c7e-8a3e-50b7f4556ee3 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-59ed8b60-818c-4b71-ae96-1f147dace5bc req-4118838b-8ee4-4c7e-8a3e-50b7f4556ee3 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:37:23 user nova-compute[74080]: WARNING nova.compute.manager [req-59ed8b60-818c-4b71-ae96-1f147dace5bc req-4118838b-8ee4-4c7e-8a3e-50b7f4556ee3 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state stopped and task_state powering-on.
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:25 user nova-compute[74080]: DEBUG nova.compute.manager [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:37:25 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance rebooted successfully.
Oct 16 07:37:25 user nova-compute[74080]: DEBUG nova.compute.manager [None req-19a00f53-9ef4-493a-bdf6-d33252c42f25 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-6d610c70-1b70-42c2-a660-7610236d0ead req-8a474f08-a299-4ccb-afcf-bfa0c9abe946 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6d610c70-1b70-42c2-a660-7610236d0ead req-8a474f08-a299-4ccb-afcf-bfa0c9abe946 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6d610c70-1b70-42c2-a660-7610236d0ead req-8a474f08-a299-4ccb-afcf-bfa0c9abe946 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6d610c70-1b70-42c2-a660-7610236d0ead req-8a474f08-a299-4ccb-afcf-bfa0c9abe946 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-6d610c70-1b70-42c2-a660-7610236d0ead req-8a474f08-a299-4ccb-afcf-bfa0c9abe946 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:37:26 user nova-compute[74080]: WARNING nova.compute.manager [req-6d610c70-1b70-42c2-a660-7610236d0ead req-8a474f08-a299-4ccb-afcf-bfa0c9abe946 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state active and task_state None.
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:37:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.manager [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '56ba6ebf-6771-4004-81b2-3f416ba0fb84', 'attached_at': '', 'detached_at': '', 'volume_id': '67ba6ec5-b121-493b-afa4-4d0716705ec0', 'serial': '67ba6ec5-b121-493b-afa4-4d0716705ec0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWfcIKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '20ee8738-f2ba-4b41-918b-55740a1e79a0'}, 'status': 'reserved', 'instance': '56ba6ebf-6771-4004-81b2-3f416ba0fb84', 'attached_at': '', 'detached_at': '', 'volume_id': '20ee8738-f2ba-4b41-918b-55740a1e79a0', 'serial'} {{(pid=74080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:28 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:37:28 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:37:28 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7139MB free_disk=25.30169677734375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45cc4e-2098-44f7-b76e-2727ab238b25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:37:28 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c33e8dd-bce8-4d80-a078-52fe344fba36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0] added
Oct 16 07:37:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250aa27-45f4-4664-b4ce-f3a33f69eb6e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6abe789-2852-49af-a757-09d52ee3e802]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcVsTLBp {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vcVsTLBp" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d569244b-41d5-49b3-8b10-b717c6f289a6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vcVsTLBp'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e4b3aaca-821e-410f-83c1-7287a48c7723 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1960a20e-bc74-4d96-8c0f-4f41e47ea82e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 20599029-1071-4ef0-8e85-825634645311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e936b802-720b-4d2a-9930-5e7b5244b2c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbfe027-c0ad-411c-85bf-e54ab01968eb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27eac62-fd09-47be-af66-1a796bce8a7e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f84979-5ce9-4607-8835-d6644ec3ef98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]
Oct 16 07:37:28 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7323566a-6a67-4205-bd52-1a20926c3995]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2c02bb-711f-47c6-8b22-f57937810da3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b80ee2-e28a-497d-a8ea-e90f74c37d1e]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:37:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.713s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.463s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23934366366653461', 'path': '/dev/sde'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934366366653461', 'path': '/dev/sde'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:37:29 user nova-compute[74080]: DEBUG nova.objects.instance [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lazy-loading 'flavor' on Instance uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 11534336 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 178257920 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 326107136 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 440401920 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-changed-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Refreshing instance network info cache due to event network-changed-20e11b12-f03f-4785-b0ed-e879fed63fe1. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] Acquiring lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] Acquired lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.network.neutron [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Refreshing network info cache for port 20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 620756992 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.objects.instance [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'flavor' on Instance uuid 7dbb5b31-5a8a-474f-91ae-642a9019fd10 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:32 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Ignoring supplied device name: /dev/vdb
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.network.neutron [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updated VIF entry in instance network info cache for port 20e11b12-f03f-4785-b0ed-e879fed63fe1. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG nova.network.neutron [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updating instance_info_cache with network_info: [{"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:32 user nova-compute[74080]: INFO nova.compute.manager [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Attaching volume cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee to /dev/vdb
Oct 16 07:37:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2e095b52-b206-46fc-9998-52e81aec6122 req-ee331962-fbc2-49ba-941e-6555ffe211a0 service nova] Releasing lock "refresh_cache-7dbb5b31-5a8a-474f-91ae-642a9019fd10" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.utils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db63df9-fcb8-4128-a30c-8524338172bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[36292b96-b47a-4511-b20d-13e8f7e29705]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9550693-9100-4d76-be1d-5e95a06e2919]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3944984-67be-417e-a90d-c23a015e660c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:33 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7caad-77d9-4885-a418-dceeff2ee47a]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.utils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updating existing volume attachment record: b41b83ee-6a1c-4185-96ec-4ad50ec74dc0 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 961544192 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSWfcIKT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '20ee8738-f2ba-4b41-918b-55740a1e79a0'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:33 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e88aec-fb3f-4ba0-af8d-8890e33cd9fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:37:33 user nova-compute[74080]: No targets found.
Oct 16 07:37:33 user nova-compute[74080]: iSNS:
Oct 16 07:37:33 user nova-compute[74080]: No targets found.
Oct 16 07:37:33 user nova-compute[74080]: STATIC:
Oct 16 07:37:33 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:37:33 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:33 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:33 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:37:33 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:33 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:33 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0
Oct 16 07:37:33 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:33 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:33 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:37:33 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:33 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:33 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0
Oct 16 07:37:33 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:37:33 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:37:33 user nova-compute[74080]: FIRMWARE:
Oct 16 07:37:33 user nova-compute[74080]: No targets found.
Oct 16 07:37:33 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:37:33 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:37:33 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2393942-b036-411f-ab45-89e7cf9f0541]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e2a0c-4754-4067-be4a-a54780eb111e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:33 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac3c40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0'): ({'sdg'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Removing single pathed devices sdg {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f637d9-aaae-4be6-acb8-8dd4ddf1c06b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce528f5d-1a10-4dfd-aca2-d472d4036ce6]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Flushing IO for device /dev/sdg {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa0266b-77f5-4738-b33c-f47cba8faa5b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdf96e9-fa30-460c-8cbd-2273838332bf]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0a9d7-329a-42e0-b122-09019ac51fc4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[619fdb21-e680-42e0-8713-4a33fee77a56]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260]
Oct 16 07:37:34 user nova-compute[74080]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:34 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ee8738-f2ba-4b41-918b-55740a1e79a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffdcd99-e27b-40a0-9f45-32483ff81c31]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] <== disconnect_volume: return (352ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:37:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:37 user nova-compute[74080]: INFO nova.compute.manager [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] [instance: e4b3aaca-821e-410f-83c1-7287a48c7723] Took 17.47 seconds to detach 1 volumes for instance.
Oct 16 07:37:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '56ba6ebf-6771-4004-81b2-3f416ba0fb84', 'attached_at': '', 'detached_at': '', 'volume_id': '67ba6ec5-b121-493b-afa4-4d0716705ec0', 'serial'} {{(pid=74080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 16 07:37:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] swap_volume: removing Cinder connection for volume 20ee8738-f2ba-4b41-918b-55740a1e79a0 {{(pid=74080) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 16 07:37:38 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:37:38 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:37:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:38 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Deleted allocations for instance e4b3aaca-821e-410f-83c1-7287a48c7723
Oct 16 07:37:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b6ce6467-90fb-46de-bd3e-e9d265064601 tempest-ServerActionsTestOtherB-885127344 tempest-ServerActionsTestOtherB-885127344-project-member] Lock "e4b3aaca-821e-410f-83c1-7287a48c7723" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.659s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] swap_volume: Updating volume 20ee8738-f2ba-4b41-918b-55740a1e79a0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vcVsTLBp", "auth_password": "BRAJKXHCIaoyej", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "67ba6ec5-b121-493b-afa4-4d0716705ec0"}, "status": "reserved", "instance": "56ba6ebf-6771-4004-81b2-3f416ba0fb84", "attached_at": "", "detached_at": "", "volume_id": "67ba6ec5-b121-493b-afa4-4d0716705ec0", "serial": "67ba6ec5-b121-493b-afa4-4d0716705ec0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '67ba6ec5-b121-493b-afa4-4d0716705ec0', 'no_device': None, 'attachment_id': 'e490dd1f-ad6c-4e74-a204-48b58fa89b56'} {{(pid=74080) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-64a1d52b-944e-4b1b-bd54-e291c639481e tempest-TestVolumeSwap-1627337458 tempest-TestVolumeSwap-1627337458-project-admin] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.684s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGnImwjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:42 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:42 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:42 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce516fac-5815-476c-9e99-4c6407ec777a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:37:42 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2519c24-c2e6-4036-8f33-a8d031ce77ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba] added
Oct 16 07:37:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e556832-ff8e-4270-94f2-729dda43dc88]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[701a3880-cd85-4a8a-b742-a9b8ae94b5ba]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGnImwjF {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGnImwjF" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a3126-6a9c-4fb8-ab64-e7a0aa99d361]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGnImwjF'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38651022-3d13-49ba-be57-f7b566277ec2]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3e07ca-e5af-4d0e-8ac2-2a6b5db8d29d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:42 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:42 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:42 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:42 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:42 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:42 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a80244f-743b-4ffd-a92c-8f2935d733b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260]
Oct 16 07:37:43 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:43 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebbf852-e08a-4f32-81ae-7985312d24fe]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0f8e32-7a53-46f3-839c-4e2081182d7e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:37:43 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:43 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:37:43 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[77427d8d-5f88-4c6c-a898-57008ca5efcb]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGnImwjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.utils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[446379ee-856e-4701-b783-e6ad98b47fbc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2034c7-1a67-46be-992a-893c41e4f4ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6420bf11-377a-4b1f-b131-1ef643e6174f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a48ed0-1605-4778-bfb0-06b2d9fc912c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:43 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a55e770-068e-429d-9a26-6d40e7130e52]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG os_brick.utils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updating existing volume attachment record: 53e0aaee-216b-4783-ba2c-335350bed82f {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:43 user nova-compute[74080]: INFO nova.compute.manager [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Detaching volume 67ba6ec5-b121-493b-afa4-4d0716705ec0
Oct 16 07:37:43 user nova-compute[74080]: INFO nova.virt.block_device [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Attempting to driver detach volume 67ba6ec5-b121-493b-afa4-4d0716705ec0 from mountpoint /dev/vdb
Oct 16 07:37:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Attempting to detach device vdb from instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:37:43 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:37:43 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:37:43 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:37:43 user nova-compute[74080]:   <serial>67ba6ec5-b121-493b-afa4-4d0716705ec0</serial>
Oct 16 07:37:43 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:37:43 user nova-compute[74080]: </disk>
Oct 16 07:37:43 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:37:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Successfully detached device vdb from instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 from the persistent domain config.
Oct 16 07:37:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:37:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:37:43 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:37:43 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:37:43 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:37:43 user nova-compute[74080]:   <serial>67ba6ec5-b121-493b-afa4-4d0716705ec0</serial>
Oct 16 07:37:43 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:37:43 user nova-compute[74080]: </disk>
Oct 16 07:37:43 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23134363532383966', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134363532383966', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG nova.objects.instance [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 20599029-1071-4ef0-8e85-825634645311 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:37:44 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:37:44 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:37:44 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:37:44 user nova-compute[74080]:   <serial>732be2ec-b413-4a01-93be-eec35c43ffba</serial>
Oct 16 07:37:44 user nova-compute[74080]: </disk>
Oct 16 07:37:44 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:37:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No VIF found with MAC fa:16:3e:6b:7e:2c, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:37:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-29b9cb89-51b7-4faa-942b-88606ba434b5 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.009s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:37:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:46 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:37:46 user nova-compute[74080]: INFO nova.compute.claims [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Claim successful on node user
Oct 16 07:37:46 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:37:46 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "20599029-1071-4ef0-8e85-825634645311" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:37:47 user nova-compute[74080]: INFO nova.compute.manager [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Detaching volume 732be2ec-b413-4a01-93be-eec35c43ffba
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:37:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:37:47 user nova-compute[74080]: INFO nova.virt.block_device [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Attempting to driver detach volume 732be2ec-b413-4a01-93be-eec35c43ffba from mountpoint /dev/vdb
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Attempting to detach device vdb from instance 20599029-1071-4ef0-8e85-825634645311 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:37:47 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:37:47 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:37:47 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:37:47 user nova-compute[74080]:   <serial>732be2ec-b413-4a01-93be-eec35c43ffba</serial>
Oct 16 07:37:47 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:37:47 user nova-compute[74080]: </disk>
Oct 16 07:37:47 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:37:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully detached device vdb from instance 20599029-1071-4ef0-8e85-825634645311 from the persistent domain config.
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20599029-1071-4ef0-8e85-825634645311 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:37:47 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:37:47 user nova-compute[74080]:   <source dev="/dev/sdf"/>
Oct 16 07:37:47 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:37:47 user nova-compute[74080]:   <serial>732be2ec-b413-4a01-93be-eec35c43ffba</serial>
Oct 16 07:37:47 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:37:47 user nova-compute[74080]: </disk>
Oct 16 07:37:47 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.policy [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c63d981ba0f4e5fa162e8f2cd6064b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee952431351406291cab2310d4a54fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:37:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Creating image(s)
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.205s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20599029-1071-4ef0-8e85-825634645311 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk 1073741824" returned: 0 in 0.050s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:47 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Successfully created port: e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Cannot resize image /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Ensure instance console log exists: /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Successfully updated port: e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquired lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-changed-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Refreshing instance network info cache due to event network-changed-e8c3048c-e1f4-4b03-86cc-eb194060a682. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] Acquiring lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:37:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updating instance_info_cache with network_info: [{"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Releasing lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance network_info: |[{"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] Acquired lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Refreshing network info cache for port e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Start _get_guest_xml network_info=[{"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:37:49 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:37:49 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-42157221',display_name='tempest-tempest.common.compute-instance-42157221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-42157221',id=25,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs9QYYmApPo/IdFZYUpvJuopfWBor9lAxprFyaOW8mIlMKQXXtBqQiy+txKogOD/oYyzWsOFmEbKYoQGKozjO5zcNKMNfcxjhdCxwKZf85uWPefm0SbTBKdqNOzO4jZ/g==',key_name='tempest-keypair-676640173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-dta6ryi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=d78e592d-691e-4fa1-9840-8f436fa17f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.objects.instance [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'pci_devices' on Instance uuid d78e592d-691e-4fa1-9840-8f436fa17f0d {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:37:49 user nova-compute[74080]:   <uuid>d78e592d-691e-4fa1-9840-8f436fa17f0d</uuid>
Oct 16 07:37:49 user nova-compute[74080]:   <name>instance-00000019</name>
Oct 16 07:37:49 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:37:49 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:37:49 user nova-compute[74080]:   <metadata>
Oct 16 07:37:49 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:37:49 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:37:49 user nova-compute[74080]:       <nova:name>tempest-tempest.common.compute-instance-42157221</nova:name>
Oct 16 07:37:49 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:37:49</nova:creationTime>
Oct 16 07:37:49 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:37:49 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:37:49 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:37:49 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:37:49 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:37:49 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:37:49 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:37:49 user nova-compute[74080]:       <nova:owner>
Oct 16 07:37:49 user nova-compute[74080]:         <nova:user uuid="0c63d981ba0f4e5fa162e8f2cd6064b9">tempest-ServerActionsTestOtherA-481627845-project-member</nova:user>
Oct 16 07:37:49 user nova-compute[74080]:         <nova:project uuid="0ee952431351406291cab2310d4a54fd">tempest-ServerActionsTestOtherA-481627845</nova:project>
Oct 16 07:37:49 user nova-compute[74080]:       </nova:owner>
Oct 16 07:37:49 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:37:49 user nova-compute[74080]:       <nova:ports>
Oct 16 07:37:49 user nova-compute[74080]:         <nova:port uuid="e8c3048c-e1f4-4b03-86cc-eb194060a682">
Oct 16 07:37:49 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:37:49 user nova-compute[74080]:         </nova:port>
Oct 16 07:37:49 user nova-compute[74080]:       </nova:ports>
Oct 16 07:37:49 user nova-compute[74080]:     </nova:instance>
Oct 16 07:37:49 user nova-compute[74080]:   </metadata>
Oct 16 07:37:49 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:37:49 user nova-compute[74080]:     <system>
Oct 16 07:37:49 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:37:49 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:37:49 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:37:49 user nova-compute[74080]:       <entry name="serial">d78e592d-691e-4fa1-9840-8f436fa17f0d</entry>
Oct 16 07:37:49 user nova-compute[74080]:       <entry name="uuid">d78e592d-691e-4fa1-9840-8f436fa17f0d</entry>
Oct 16 07:37:49 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:37:49 user nova-compute[74080]:     </system>
Oct 16 07:37:49 user nova-compute[74080]:   </sysinfo>
Oct 16 07:37:49 user nova-compute[74080]:   <os>
Oct 16 07:37:49 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:37:49 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:37:49 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:37:49 user nova-compute[74080]:   </os>
Oct 16 07:37:49 user nova-compute[74080]:   <features>
Oct 16 07:37:49 user nova-compute[74080]:     <acpi/>
Oct 16 07:37:49 user nova-compute[74080]:     <apic/>
Oct 16 07:37:49 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:37:49 user nova-compute[74080]:   </features>
Oct 16 07:37:49 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:37:49 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:37:49 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:37:49 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:37:49 user nova-compute[74080]:   </clock>
Oct 16 07:37:49 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:37:49 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:37:49 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:37:49 user nova-compute[74080]:   </cpu>
Oct 16 07:37:49 user nova-compute[74080]:   <devices>
Oct 16 07:37:49 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:37:49 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:37:49 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk"/>
Oct 16 07:37:49 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:37:49 user nova-compute[74080]:     </disk>
Oct 16 07:37:49 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:37:49 user nova-compute[74080]:       <mac address="fa:16:3e:cb:9a:c4"/>
Oct 16 07:37:49 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:37:49 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:37:49 user nova-compute[74080]:       <target dev="tape8c3048c-e1"/>
Oct 16 07:37:49 user nova-compute[74080]:     </interface>
Oct 16 07:37:49 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:37:49 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/console.log" append="off"/>
Oct 16 07:37:49 user nova-compute[74080]:     </serial>
Oct 16 07:37:49 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:37:49 user nova-compute[74080]:     <video>
Oct 16 07:37:49 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:37:49 user nova-compute[74080]:     </video>
Oct 16 07:37:49 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:37:49 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:37:49 user nova-compute[74080]:     </rng>
Oct 16 07:37:49 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:37:49 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:37:49 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:37:49 user nova-compute[74080]:     </memballoon>
Oct 16 07:37:49 user nova-compute[74080]:   </devices>
Oct 16 07:37:49 user nova-compute[74080]: </domain>
Oct 16 07:37:49 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-42157221',display_name='tempest-tempest.common.compute-instance-42157221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-42157221',id=25,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs9QYYmApPo/IdFZYUpvJuopfWBor9lAxprFyaOW8mIlMKQXXtBqQiy+txKogOD/oYyzWsOFmEbKYoQGKozjO5zcNKMNfcxjhdCxwKZf85uWPefm0SbTBKdqNOzO4jZ/g==',key_name='tempest-keypair-676640173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-dta6ryi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=d78e592d-691e-4fa1-9840-8f436fa17f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG os_vif [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7b92e1c-e0e4-5115-ba34-ec7984741067', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c3048c-e1, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8c3048c-e1, col_values=(('qos', UUID('e1226a45-b1d4-4659-b6df-853c77429a05')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8c3048c-e1, col_values=(('external_ids', {'iface-id': 'e8c3048c-e1f4-4b03-86cc-eb194060a682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:9a:c4', 'vm-uuid': 'd78e592d-691e-4fa1-9840-8f436fa17f0d'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:49 user nova-compute[74080]: INFO os_vif [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1')
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No VIF found with MAC fa:16:3e:cb:9a:c4, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updated VIF entry in instance network info cache for port e8c3048c-e1f4-4b03-86cc-eb194060a682. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updating instance_info_cache with network_info: [{"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:37:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a91205ed-c9ba-4415-be20-ce899408553d req-547a81d0-effd-4394-848f-94926d936912 service nova] Releasing lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'napoxlCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:50 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:50 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:37:50 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb86039-ff12-4133-a31a-bcaf6ea876d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:37:50 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0576c8-c0ee-4891-8677-3510d7463198]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee] added
Oct 16 07:37:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d9cdbe-ff3f-4f4c-8a6d-242b72f377fe]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b9e72-e705-49c9-8372-ceef6f8e8c1c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v napoxlCM {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v napoxlCM" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd473246-cd3f-4677-9ffa-28fb6ad27dec]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'napoxlCM'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3082bb1a-1205-43cc-b121-10a4558b0b27]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6218cc-8b57-4388-81ce-387ca6b31aff]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:37:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:37:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b149c0-d64c-4dba-87b1-62910d8bd162]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260]
Oct 16 07:37:50 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260] successful.
Oct 16 07:37:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1a1944-d403-46fe-85b3-38664386fde1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1215c1b9-a45c-4935-a32e-9c3681c4dcfa]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:37:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:37:50 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:37:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] HCTL ('38', '-', '-', 0) found on session 28 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db1d72f-997a-4c27-b06f-0cee0c7fc48f]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Searching for a device in session 28 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'napoxlCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-bb4b268f-b3f2-4d5f-814e-5ee1b3f5e310 req-fb4d89fc-bc08-45b4-a330-81394c069bf5 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bb4b268f-b3f2-4d5f-814e-5ee1b3f5e310 req-fb4d89fc-bc08-45b4-a330-81394c069bf5 service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bb4b268f-b3f2-4d5f-814e-5ee1b3f5e310 req-fb4d89fc-bc08-45b4-a330-81394c069bf5 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bb4b268f-b3f2-4d5f-814e-5ee1b3f5e310 req-fb4d89fc-bc08-45b4-a330-81394c069bf5 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-bb4b268f-b3f2-4d5f-814e-5ee1b3f5e310 req-fb4d89fc-bc08-45b4-a330-81394c069bf5 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:37:51 user nova-compute[74080]: WARNING nova.compute.manager [req-bb4b268f-b3f2-4d5f-814e-5ee1b3f5e310 req-fb4d89fc-bc08-45b4-a330-81394c069bf5 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received unexpected event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with vm_state building and task_state spawning.
Oct 16 07:37:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23831623966386135', 'path': '/dev/sdg'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831623966386135', 'path': '/dev/sdg'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.objects.instance [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'flavor' on Instance uuid 7dbb5b31-5a8a-474f-91ae-642a9019fd10 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:37:51 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:37:51 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:37:51 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:37:51 user nova-compute[74080]:   <serial>cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee</serial>
Oct 16 07:37:51 user nova-compute[74080]: </disk>
Oct 16 07:37:51 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:37:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No VIF found with MAC fa:16:3e:aa:29:4d, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bd92512c-dea8-40bc-b18c-c0b68ec3715f tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.240s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.objects.instance [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'flavor' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:52 user nova-compute[74080]: INFO nova.compute.manager [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Attaching volume da228469-2aef-44ec-9590-4267470f6e1b to /dev/vdb
Oct 16 07:37:52 user nova-compute[74080]: DEBUG os_brick.utils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9467cea8-08ab-4201-9caa-1206c89836ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[80911448-1857-44ad-bd10-62d3780c7580]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6769c15-da7f-41d5-8dd0-410d46ad26b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbfc072-8302-47e4-a263-bd2236d29a11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:37:52 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:37:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9950204-69d4-480c-87c2-2e1644e4255a]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG os_brick.utils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating existing volume attachment record: 26f16d48-c8ab-4208-914b-08d6cc537cde {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:37:52 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance spawned successfully.
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:37:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:37:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-1959d2c2-369d-45d1-abea-58e0f4faf7d5 req-6921196b-95ba-4980-a8d4-65a33ae2972a service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:37:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1959d2c2-369d-45d1-abea-58e0f4faf7d5 req-6921196b-95ba-4980-a8d4-65a33ae2972a service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:37:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1959d2c2-369d-45d1-abea-58e0f4faf7d5 req-6921196b-95ba-4980-a8d4-65a33ae2972a service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:37:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1959d2c2-369d-45d1-abea-58e0f4faf7d5 req-6921196b-95ba-4980-a8d4-65a33ae2972a service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-1959d2c2-369d-45d1-abea-58e0f4faf7d5 req-6921196b-95ba-4980-a8d4-65a33ae2972a service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:37:53 user nova-compute[74080]: WARNING nova.compute.manager [req-1959d2c2-369d-45d1-abea-58e0f4faf7d5 req-6921196b-95ba-4980-a8d4-65a33ae2972a service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received unexpected event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with vm_state building and task_state spawning.
Oct 16 07:37:53 user nova-compute[74080]: INFO nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Took 5.78 seconds to spawn the instance on the hypervisor.
Oct 16 07:37:53 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:37:53 user nova-compute[74080]: INFO nova.compute.manager [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Took 6.75 seconds to build instance.
Oct 16 07:37:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c0996c7c-0102-427b-b3fc-1f8dde874119 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.866s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:37:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:37:59 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:04 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 is timed out.
Oct 16 07:38:04 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Successfully detached device vdb from instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 from the live domain config.
Oct 16 07:38:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vcVsTLBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '67ba6ec5-b121-493b-afa4-4d0716705ec0'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:38:04 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9800cd7-8e4d-47e1-af51-6fbd43d43610]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:38:04 user nova-compute[74080]: No targets found.
Oct 16 07:38:04 user nova-compute[74080]: iSNS:
Oct 16 07:38:04 user nova-compute[74080]: No targets found.
Oct 16 07:38:04 user nova-compute[74080]: STATIC:
Oct 16 07:38:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:38:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:38:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0
Oct 16 07:38:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee
Oct 16 07:38:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:38:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba
Oct 16 07:38:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:04 user nova-compute[74080]: FIRMWARE:
Oct 16 07:38:04 user nova-compute[74080]: No targets found.
Oct 16 07:38:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:38:04 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:38:04 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb8a8be-eec3-44a3-97cb-28ae3d58b213]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b5280f-8266-41a7-8f83-21a3d03bfe0e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:38:04 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac425fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0'): ({'sde'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Removing single pathed devices sde {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e4366c-ed06-4dd6-9295-72e69a15efcb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[673ff6d1-fe44-4208-8f3c-65c5c5c2bc00]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Flushing IO for device /dev/sde {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d435d451-a03f-42af-ae0d-89efe431b6a5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae16b68-6f99-4ce9-973c-621ddece0c38]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b594c-b6bf-40bc-a5b3-e57798e9208e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84751510-5e79-40fe-becb-cb9091b664e2]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260]
Oct 16 07:38:04 user nova-compute[74080]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0, portal: 172.16.0.220,3260] successful.
Oct 16 07:38:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67ba6ec5-b121-493b-afa4-4d0716705ec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa25b7db-efbe-44a8-a141-736a7633db41]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] <== disconnect_volume: return (331ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:38:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:38:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lazy-loading 'flavor' on Instance uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7b504d74-bc7d-4251-b4db-4eb47d10ae6f tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:07 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 20599029-1071-4ef0-8e85-825634645311 is timed out.
Oct 16 07:38:07 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully detached device vdb from instance 20599029-1071-4ef0-8e85-825634645311 from the live domain config.
Oct 16 07:38:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGnImwjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:38:07 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a31d29-aeff-42cc-8ab0-0691e994052c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:38:07 user nova-compute[74080]: No targets found.
Oct 16 07:38:07 user nova-compute[74080]: iSNS:
Oct 16 07:38:07 user nova-compute[74080]: No targets found.
Oct 16 07:38:07 user nova-compute[74080]: STATIC:
Oct 16 07:38:07 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:38:07 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:07 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:07 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:38:07 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:07 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:07 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee
Oct 16 07:38:07 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:07 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:07 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:38:07 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:07 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:07 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba
Oct 16 07:38:07 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:07 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:07 user nova-compute[74080]: FIRMWARE:
Oct 16 07:38:07 user nova-compute[74080]: No targets found.
Oct 16 07:38:07 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:38:07 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:38:07 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd29daa-abf9-4831-b023-8a339801b17e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb0e72-a9cb-4186-8495-d6013524dec7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:07 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba (non-flash)
Oct 16 07:38:07 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:07 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac4252d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba'): ({'sdf'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Removing single pathed devices sdf {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa15582a-f2fc-4f5d-bca3-0e747148e737]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f268e6dd-6b68-45e0-9bb3-769a36e3fb9d]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flushing IO for device /dev/sdf {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1aa1b7-edee-4a31-ae72-e3157c2fcef9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[65af601e-94be-45fb-b729-9c9438c41d91]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] SCSI volumes sdf have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f984c-f370-4710-ad3f-8701e4d9d9f3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a495f4bf-8651-4474-9180-91ab278f713e]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260]
Oct 16 07:38:08 user nova-compute[74080]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba, portal: 172.16.0.220,3260] successful.
Oct 16 07:38:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:732be2ec-b413-4a01-93be-eec35c43ffba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c715194-5812-4adc-9298-b7309a7b47fb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== disconnect_volume: return (316ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG nova.objects.instance [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 20599029-1071-4ef0-8e85-825634645311 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8b4832c1-abf7-47dd-9531-a68061ac0563 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.901s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:09 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "5a35de85-4095-4a93-8d33-a4577b960b95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:38:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:19 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:38:19 user nova-compute[74080]: INFO nova.compute.claims [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Claim successful on node user
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:38:20 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:38:20 user nova-compute[74080]: INFO nova.virt.block_device [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Booting with blank volume at /dev/vda
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.policy [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf2fbffe5a5544dba338662d437d5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea8d62574f84ae6a83ee19b7b03c21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Skipping network cache update for instance because it is Building. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 07:38:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Skipping network cache update for instance because it is Building. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 07:38:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:38:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:38:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:38:21 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lazy-loading 'info_cache' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Successfully created port: 428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:38:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Successfully updated port: 428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquired lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-changed-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Refreshing instance network info cache due to event network-changed-428a165b-6148-4fe5-a539-dad7bbb9a399. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] Acquiring lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:22 user nova-compute[74080]: INFO nova.compute.manager [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Terminating instance
Oct 16 07:38:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Updating instance_info_cache with network_info: [{"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Releasing lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance network_info: |[{"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] Acquired lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Refreshing network info cache for port 428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-318f5e1b-8bac-49ea-b998-ac2d54d5625f req-2a45f76f-711f-4096-894d-a09ad8f6c9be service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-unplugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-318f5e1b-8bac-49ea-b998-ac2d54d5625f req-2a45f76f-711f-4096-894d-a09ad8f6c9be service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-318f5e1b-8bac-49ea-b998-ac2d54d5625f req-2a45f76f-711f-4096-894d-a09ad8f6c9be service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-318f5e1b-8bac-49ea-b998-ac2d54d5625f req-2a45f76f-711f-4096-894d-a09ad8f6c9be service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-318f5e1b-8bac-49ea-b998-ac2d54d5625f req-2a45f76f-711f-4096-894d-a09ad8f6c9be service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-unplugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-318f5e1b-8bac-49ea-b998-ac2d54d5625f req-2a45f76f-711f-4096-894d-a09ad8f6c9be service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-unplugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Instance destroyed successfully.
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.objects.instance [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lazy-loading 'resources' on Instance uuid 1960a20e-bc74-4d96-8c0f-4f41e47ea82e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:33:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1579119968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-687647800',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPWg4YdQesoVuM/WrNXQW+kIdOFM6JSECUZzdALHq04v1FQWToM3QSyK/Ofd2DdWjWBU+/BJZzQGaQqaBqWByl2HZtKVlxS1w7xeSk0FxNaH8bNrQPLeM2SYusDF4mUtQ==',key_name='tempest-keypair-1129031097',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d056746711e9427e84183bb13bdf386b',ramdisk_id='',reservation_id='r-1w49mmmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-200374556',owner_user_name='tempest-ServerActionsV293TestJSON-200374556-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f9ce6a7e3fc4f1c8edab7788688213a',uuid=1960a20e-bc74-4d96-8c0f-4f41e47ea82e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converting VIF {"id": "c792e524-2ccb-4033-9db1-56ccf22a11be", "address": "fa:16:3e:9d:8d:46", "network": {"id": "f46e5d7e-84c4-444a-8975-d8820609a70d", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-745619199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d056746711e9427e84183bb13bdf386b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc792e524-2c", "ovs_interfaceid": "c792e524-2ccb-4033-9db1-56ccf22a11be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_vif [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc792e524-2c, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e25b9a6c-a5fc-41b2-8186-5e7a3feca61d) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:23 user nova-compute[74080]: INFO os_vif [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:8d:46,bridge_name='br-int',has_traffic_filtering=True,id=c792e524-2ccb-4033-9db1-56ccf22a11be,network=Network(f46e5d7e-84c4-444a-8975-d8820609a70d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc792e524-2c')
Oct 16 07:38:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWniSGuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:38:23 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c59136d-a7a4-4a64-96db-7bd99cf614f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:38:23 user nova-compute[74080]: No targets found.
Oct 16 07:38:23 user nova-compute[74080]: iSNS:
Oct 16 07:38:23 user nova-compute[74080]: No targets found.
Oct 16 07:38:23 user nova-compute[74080]: STATIC:
Oct 16 07:38:23 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:38:23 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:23 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:23 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:38:23 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:23 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:23 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee
Oct 16 07:38:23 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:23 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:23 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf
Oct 16 07:38:23 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:38:23 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:38:23 user nova-compute[74080]: FIRMWARE:
Oct 16 07:38:23 user nova-compute[74080]: No targets found.
Oct 16 07:38:23 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:38:23 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:38:23 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ccceb5-bf7e-49b9-a79b-72d9e3e55e29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cef717b-a8cd-4895-9b69-f4935f712391]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:23 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:38:23 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:23 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:23 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:23 user nova-compute[74080]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf (non-flash)
Oct 16 07:38:23 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:23 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:23 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac425000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf'): ({'sdd'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Removing single pathed devices sdd {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[340b59dd-670d-4853-bb18-32b3b6d4010d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb39a0d4-8fe8-4f96-96e9-1e276d137f5c]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Flushing IO for device /dev/sdd {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c6e95-08c4-4126-a892-2dfa32636890]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:38:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG nova.network.neutron [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Updated VIF entry in instance network info cache for port 428a165b-6148-4fe5-a539-dad7bbb9a399. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG nova.network.neutron [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Updating instance_info_cache with network_info: [{"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a68728-c09b-4b9c-97b0-d0495b1d3650]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-422019b2-1868-47f4-9c95-b1e33bb1ee21 req-9ec4f07f-ed6c-424e-9575-e50decbace3c service nova] Releasing lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e40ac60-e9f4-4ba1-8245-443297ddcf17]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd14c09a-3889-41b2-b881-a02547b45cc8]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260]
Oct 16 07:38:24 user nova-compute[74080]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf, portal: 172.16.0.220,3260] successful.
Oct 16 07:38:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b4ab4cc-fc59-408a-a868-cfbdef70a3cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[501d0f6d-e4f2-4cd0-ae8e-b0011c23797f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] <== disconnect_volume: return (478ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:38:24 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Deleting instance files /opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e_del
Oct 16 07:38:24 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Deletion of /opt/stack/data/nova/instances/1960a20e-bc74-4d96-8c0f-4f41e47ea82e_del complete
Oct 16 07:38:24 user nova-compute[74080]: INFO nova.compute.manager [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Took 1.58 seconds to destroy the instance on the hypervisor.
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:38:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-b10092a9-b977-41ce-bbc8-29f4d89f8a2a req-60a11dd9-c359-41e2-9ff7-14be0c2714a4 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b10092a9-b977-41ce-bbc8-29f4d89f8a2a req-60a11dd9-c359-41e2-9ff7-14be0c2714a4 service nova] Acquiring lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b10092a9-b977-41ce-bbc8-29f4d89f8a2a req-60a11dd9-c359-41e2-9ff7-14be0c2714a4 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b10092a9-b977-41ce-bbc8-29f4d89f8a2a req-60a11dd9-c359-41e2-9ff7-14be0c2714a4 service nova] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-b10092a9-b977-41ce-bbc8-29f4d89f8a2a req-60a11dd9-c359-41e2-9ff7-14be0c2714a4 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] No waiting events found dispatching network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:25 user nova-compute[74080]: WARNING nova.compute.manager [req-b10092a9-b977-41ce-bbc8-29f4d89f8a2a req-60a11dd9-c359-41e2-9ff7-14be0c2714a4 service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received unexpected event network-vif-plugged-c792e524-2ccb-4033-9db1-56ccf22a11be for instance with vm_state active and task_state deleting.
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:25 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Took 1.21 seconds to deallocate network for instance.
Oct 16 07:38:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-c40dbf50-84af-4926-a5e6-6a61a2f52c8b req-3b10b657-4e46-44d9-97ed-92936892201e service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Received event network-vif-deleted-c792e524-2ccb-4033-9db1-56ccf22a11be {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:25 user nova-compute[74080]: INFO nova.compute.manager [req-c40dbf50-84af-4926-a5e6-6a61a2f52c8b req-3b10b657-4e46-44d9-97ed-92936892201e service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Neutron deleted interface c792e524-2ccb-4033-9db1-56ccf22a11be; detaching it from the instance and deleting it from the info cache
Oct 16 07:38:25 user nova-compute[74080]: DEBUG nova.network.neutron [req-c40dbf50-84af-4926-a5e6-6a61a2f52c8b req-3b10b657-4e46-44d9-97ed-92936892201e service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-c40dbf50-84af-4926-a5e6-6a61a2f52c8b req-3b10b657-4e46-44d9-97ed-92936892201e service nova] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Detach interface failed, port_id=c792e524-2ccb-4033-9db1-56ccf22a11be, reason: Instance 1960a20e-bc74-4d96-8c0f-4f41e47ea82e could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:26 user nova-compute[74080]: INFO nova.compute.manager [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Took 1.07 seconds to detach 1 volumes for instance.
Oct 16 07:38:26 user nova-compute[74080]: DEBUG nova.compute.manager [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] [instance: 1960a20e-bc74-4d96-8c0f-4f41e47ea82e] Deleting volume: 7b4ab4cc-fc59-408a-a868-cfbdef70a3cf {{(pid=74080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG os_brick.utils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7921b131-a15c-441f-b2ce-c57b02993739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5157f42a-7e5b-453e-b924-719493031b4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aded05-82ca-4646-bf01-a20792ceaa59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[facf221f-0eba-4109-9663-ed5d730a8d2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7019MB free_disk=25.26019287109375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:38:27 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab577fb5-5908-4eb9-a84f-5c61fd7fde77]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG os_brick.utils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] <== get_connector_properties: return (560ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Updating existing volume attachment record: 2e934665-80a5-4c2a-86bd-101362ef56b1 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.939s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.315s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:27 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Deleted allocations for instance 1960a20e-bc74-4d96-8c0f-4f41e47ea82e
Oct 16 07:38:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0cc661be-5ecb-45c0-8bc1-6eaf31ddb4a5 tempest-ServerActionsV293TestJSON-200374556 tempest-ServerActionsV293TestJSON-200374556-project-member] Lock "1960a20e-bc74-4d96-8c0f-4f41e47ea82e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.412s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 20599029-1071-4ef0-8e85-825634645311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e936b802-720b-4d2a-9930-5e7b5244b2c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d78e592d-691e-4fa1-9840-8f436fa17f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:28 user nova-compute[74080]: INFO nova.compute.manager [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Rescuing
Oct 16 07:38:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquired lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:38:28 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Updating instance_info_cache with network_info: [{"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Releasing lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:29 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Instance destroyed successfully.
Oct 16 07:38:29 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Attempting rescue
Oct 16 07:38:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Instance directory exists: not creating {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 07:38:29 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Creating image(s)
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue" returned: 0 in 0.048s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'migration_context' on Instance uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.base [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<8a89c84b-8e61-4290-b4e6-fe1c2bc738e3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Start _get_guest_xml network_info=[{"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:1e:d9:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'resources' on Instance uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.base [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<8a89c84b-8e61-4290-b4e6-fe1c2bc738e3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.base [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<8a89c84b-8e61-4290-b4e6-fe1c2bc738e3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:38:30 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:30 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.base [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<8a89c84b-8e61-4290-b4e6-fe1c2bc738e3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-666762875',display_name='tempest-ServerRescueNegativeTestJSON-server-666762875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-666762875',id=23,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-cj6nph7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:48Z,user_data=None,user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=8a89c84b-8e61-4290-b4e6-fe1c2bc738e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:1e:d9:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:1e:d9:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:d9:87,bridge_name='br-int',has_traffic_filtering=True,id=ddb9b43e-338c-42c6-a93b-80c3a638c387,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddb9b43e-33') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.objects.base [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<8a89c84b-8e61-4290-b4e6-fe1c2bc738e3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:38:30 user nova-compute[74080]:   <uuid>8a89c84b-8e61-4290-b4e6-fe1c2bc738e3</uuid>
Oct 16 07:38:30 user nova-compute[74080]:   <name>instance-00000017</name>
Oct 16 07:38:30 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:38:30 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:38:30 user nova-compute[74080]:   <metadata>
Oct 16 07:38:30 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:38:30 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:38:30 user nova-compute[74080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-666762875</nova:name>
Oct 16 07:38:30 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:38:30</nova:creationTime>
Oct 16 07:38:30 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:38:30 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:38:30 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:38:30 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:38:30 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:38:30 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:38:30 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:38:30 user nova-compute[74080]:       <nova:owner>
Oct 16 07:38:30 user nova-compute[74080]:         <nova:user uuid="8537fd36ebd340b09c830ab09cd16d0b">tempest-ServerRescueNegativeTestJSON-2029305131-project-member</nova:user>
Oct 16 07:38:30 user nova-compute[74080]:         <nova:project uuid="479d15d0c8ae430096c24dd442ce1e78">tempest-ServerRescueNegativeTestJSON-2029305131</nova:project>
Oct 16 07:38:30 user nova-compute[74080]:       </nova:owner>
Oct 16 07:38:30 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:38:30 user nova-compute[74080]:       <nova:ports>
Oct 16 07:38:30 user nova-compute[74080]:         <nova:port uuid="ddb9b43e-338c-42c6-a93b-80c3a638c387">
Oct 16 07:38:30 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 07:38:30 user nova-compute[74080]:         </nova:port>
Oct 16 07:38:30 user nova-compute[74080]:       </nova:ports>
Oct 16 07:38:30 user nova-compute[74080]:     </nova:instance>
Oct 16 07:38:30 user nova-compute[74080]:   </metadata>
Oct 16 07:38:30 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:38:30 user nova-compute[74080]:     <system>
Oct 16 07:38:30 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:38:30 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:38:30 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:38:30 user nova-compute[74080]:       <entry name="serial">8a89c84b-8e61-4290-b4e6-fe1c2bc738e3</entry>
Oct 16 07:38:30 user nova-compute[74080]:       <entry name="uuid">8a89c84b-8e61-4290-b4e6-fe1c2bc738e3</entry>
Oct 16 07:38:30 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:38:30 user nova-compute[74080]:     </system>
Oct 16 07:38:30 user nova-compute[74080]:   </sysinfo>
Oct 16 07:38:30 user nova-compute[74080]:   <os>
Oct 16 07:38:30 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:38:30 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:38:30 user nova-compute[74080]:   </os>
Oct 16 07:38:30 user nova-compute[74080]:   <features>
Oct 16 07:38:30 user nova-compute[74080]:     <acpi/>
Oct 16 07:38:30 user nova-compute[74080]:     <apic/>
Oct 16 07:38:30 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:38:30 user nova-compute[74080]:   </features>
Oct 16 07:38:30 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:38:30 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:38:30 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:38:30 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:38:30 user nova-compute[74080]:   </clock>
Oct 16 07:38:30 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:38:30 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:38:30 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:38:30 user nova-compute[74080]:   </cpu>
Oct 16 07:38:30 user nova-compute[74080]:   <devices>
Oct 16 07:38:30 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:38:30 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:38:30 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue"/>
Oct 16 07:38:30 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:38:30 user nova-compute[74080]:     </disk>
Oct 16 07:38:30 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:38:30 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:38:30 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk"/>
Oct 16 07:38:30 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:38:30 user nova-compute[74080]:     </disk>
Oct 16 07:38:30 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:38:30 user nova-compute[74080]:       <mac address="fa:16:3e:1e:d9:87"/>
Oct 16 07:38:30 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:38:30 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:38:30 user nova-compute[74080]:       <target dev="tapddb9b43e-33"/>
Oct 16 07:38:30 user nova-compute[74080]:     </interface>
Oct 16 07:38:30 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:38:30 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/console.log" append="off"/>
Oct 16 07:38:30 user nova-compute[74080]:     </serial>
Oct 16 07:38:30 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:38:30 user nova-compute[74080]:     <video>
Oct 16 07:38:30 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:38:30 user nova-compute[74080]:     </video>
Oct 16 07:38:30 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:38:30 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:38:30 user nova-compute[74080]:     </rng>
Oct 16 07:38:30 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:38:30 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:38:30 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:38:30 user nova-compute[74080]:     </memballoon>
Oct 16 07:38:30 user nova-compute[74080]:   </devices>
Oct 16 07:38:30 user nova-compute[74080]: </domain>
Oct 16 07:38:30 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:38:30 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Instance destroyed successfully.
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:38:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No VIF found with MAC fa:16:3e:1e:d9:87, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-e7cad986-4d60-460b-98b7-586f880702fb req-9ce5c04b-e113-4eb1-af2f-24f585e52b5b service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received event network-vif-unplugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e7cad986-4d60-460b-98b7-586f880702fb req-9ce5c04b-e113-4eb1-af2f-24f585e52b5b service nova] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e7cad986-4d60-460b-98b7-586f880702fb req-9ce5c04b-e113-4eb1-af2f-24f585e52b5b service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e7cad986-4d60-460b-98b7-586f880702fb req-9ce5c04b-e113-4eb1-af2f-24f585e52b5b service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG nova.compute.manager [req-e7cad986-4d60-460b-98b7-586f880702fb req-9ce5c04b-e113-4eb1-af2f-24f585e52b5b service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] No waiting events found dispatching network-vif-unplugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:31 user nova-compute[74080]: WARNING nova.compute.manager [req-e7cad986-4d60-460b-98b7-586f880702fb req-9ce5c04b-e113-4eb1-af2f-24f585e52b5b service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received unexpected event network-vif-unplugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 for instance with vm_state active and task_state rescuing.
Oct 16 07:38:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-d83f0e00-661e-49d7-8b34-b7c1b539fff3 req-f542195d-689c-4b83-9b6c-e60631da848d service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d83f0e00-661e-49d7-8b34-b7c1b539fff3 req-f542195d-689c-4b83-9b6c-e60631da848d service nova] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d83f0e00-661e-49d7-8b34-b7c1b539fff3 req-f542195d-689c-4b83-9b6c-e60631da848d service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d83f0e00-661e-49d7-8b34-b7c1b539fff3 req-f542195d-689c-4b83-9b6c-e60631da848d service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-d83f0e00-661e-49d7-8b34-b7c1b539fff3 req-f542195d-689c-4b83-9b6c-e60631da848d service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] No waiting events found dispatching network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:33 user nova-compute[74080]: WARNING nova.compute.manager [req-d83f0e00-661e-49d7-8b34-b7c1b539fff3 req-f542195d-689c-4b83-9b6c-e60631da848d service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received unexpected event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 for instance with vm_state active and task_state rescuing.
Oct 16 07:38:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6bea4af3-deb8-4d82-b42e-8b23db9e9d3d tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:38:34 user nova-compute[74080]: INFO nova.compute.claims [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Claim successful on node user
Oct 16 07:38:34 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:38:34 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:38:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:38:35 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG nova.policy [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db721d9235c64087bf54998e468b7f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb49371c30764797a229c88006622241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:38:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Creating image(s)
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk 1073741824" returned: 0 in 0.138s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:35 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Successfully created port: dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Cannot resize image /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Ensure instance console log exists: /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Successfully updated port: dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquired lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing instance network info cache due to event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:38:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] Acquiring lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.neutron [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Releasing lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance network_info: |[{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] Acquired lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.neutron [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Start _get_guest_xml network_info=[{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:38:37 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:37 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1117384875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1117384875',id=27,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeOc6LSMg448zm8oKp/CpvM45DyfJHK3JogQFSdvOw52HcyFNVd6oqizTCDKiNffHJwyyEUp8xQTjfbCIeH4Pmt/3ZETdBYDJNEqoJ1MFg8dUL7Ck+E0j406SgVFQNCVg==',key_name='tempest-keypair-1371470985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-nvxk32j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=d3e5e8b9-5b6f-446a-aabe-2944817a3756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.objects.instance [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'pci_devices' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:38:37 user nova-compute[74080]:   <uuid>d3e5e8b9-5b6f-446a-aabe-2944817a3756</uuid>
Oct 16 07:38:37 user nova-compute[74080]:   <name>instance-0000001b</name>
Oct 16 07:38:37 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:38:37 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:38:37 user nova-compute[74080]:   <metadata>
Oct 16 07:38:37 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:38:37 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:38:37 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1117384875</nova:name>
Oct 16 07:38:37 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:38:37</nova:creationTime>
Oct 16 07:38:37 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:38:37 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:38:37 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:38:37 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:38:37 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:38:37 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:38:37 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:38:37 user nova-compute[74080]:       <nova:owner>
Oct 16 07:38:37 user nova-compute[74080]:         <nova:user uuid="db721d9235c64087bf54998e468b7f3e">tempest-AttachVolumeShelveTestJSON-2100146647-project-member</nova:user>
Oct 16 07:38:37 user nova-compute[74080]:         <nova:project uuid="cb49371c30764797a229c88006622241">tempest-AttachVolumeShelveTestJSON-2100146647</nova:project>
Oct 16 07:38:37 user nova-compute[74080]:       </nova:owner>
Oct 16 07:38:37 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:38:37 user nova-compute[74080]:       <nova:ports>
Oct 16 07:38:37 user nova-compute[74080]:         <nova:port uuid="dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3">
Oct 16 07:38:37 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:38:37 user nova-compute[74080]:         </nova:port>
Oct 16 07:38:37 user nova-compute[74080]:       </nova:ports>
Oct 16 07:38:37 user nova-compute[74080]:     </nova:instance>
Oct 16 07:38:37 user nova-compute[74080]:   </metadata>
Oct 16 07:38:37 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:38:37 user nova-compute[74080]:     <system>
Oct 16 07:38:37 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:38:37 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:38:37 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:38:37 user nova-compute[74080]:       <entry name="serial">d3e5e8b9-5b6f-446a-aabe-2944817a3756</entry>
Oct 16 07:38:37 user nova-compute[74080]:       <entry name="uuid">d3e5e8b9-5b6f-446a-aabe-2944817a3756</entry>
Oct 16 07:38:37 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:38:37 user nova-compute[74080]:     </system>
Oct 16 07:38:37 user nova-compute[74080]:   </sysinfo>
Oct 16 07:38:37 user nova-compute[74080]:   <os>
Oct 16 07:38:37 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:38:37 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:38:37 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:38:37 user nova-compute[74080]:   </os>
Oct 16 07:38:37 user nova-compute[74080]:   <features>
Oct 16 07:38:37 user nova-compute[74080]:     <acpi/>
Oct 16 07:38:37 user nova-compute[74080]:     <apic/>
Oct 16 07:38:37 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:38:37 user nova-compute[74080]:   </features>
Oct 16 07:38:37 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:38:37 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:38:37 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:38:37 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:38:37 user nova-compute[74080]:   </clock>
Oct 16 07:38:37 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:38:37 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:38:37 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:38:37 user nova-compute[74080]:   </cpu>
Oct 16 07:38:37 user nova-compute[74080]:   <devices>
Oct 16 07:38:37 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:38:37 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:38:37 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk"/>
Oct 16 07:38:37 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:38:37 user nova-compute[74080]:     </disk>
Oct 16 07:38:37 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:38:37 user nova-compute[74080]:       <mac address="fa:16:3e:bb:fd:24"/>
Oct 16 07:38:37 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:38:37 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:38:37 user nova-compute[74080]:       <target dev="tapdab1e9e8-5b"/>
Oct 16 07:38:37 user nova-compute[74080]:     </interface>
Oct 16 07:38:37 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:38:37 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/console.log" append="off"/>
Oct 16 07:38:37 user nova-compute[74080]:     </serial>
Oct 16 07:38:37 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:38:37 user nova-compute[74080]:     <video>
Oct 16 07:38:37 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:38:37 user nova-compute[74080]:     </video>
Oct 16 07:38:37 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:38:37 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:38:37 user nova-compute[74080]:     </rng>
Oct 16 07:38:37 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:38:37 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:38:37 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:38:37 user nova-compute[74080]:     </memballoon>
Oct 16 07:38:37 user nova-compute[74080]:   </devices>
Oct 16 07:38:37 user nova-compute[74080]: </domain>
Oct 16 07:38:37 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1117384875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1117384875',id=27,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeOc6LSMg448zm8oKp/CpvM45DyfJHK3JogQFSdvOw52HcyFNVd6oqizTCDKiNffHJwyyEUp8xQTjfbCIeH4Pmt/3ZETdBYDJNEqoJ1MFg8dUL7Ck+E0j406SgVFQNCVg==',key_name='tempest-keypair-1371470985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-nvxk32j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:38:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=d3e5e8b9-5b6f-446a-aabe-2944817a3756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG os_vif [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39eb163f-8eb5-5d05-ab89-4e75c1e2b44f', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab1e9e8-5b, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdab1e9e8-5b, col_values=(('qos', UUID('ff5331cf-0a83-4bdf-ad9d-1cc0f1886c72')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdab1e9e8-5b, col_values=(('external_ids', {'iface-id': 'dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:fd:24', 'vm-uuid': 'd3e5e8b9-5b6f-446a-aabe-2944817a3756'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:37 user nova-compute[74080]: INFO os_vif [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b')
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] No VIF found with MAC fa:16:3e:bb:fd:24, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-e3623867-97ff-4f5f-a1ec-427c0e534466 req-f1d84577-4819-492b-a293-15969dd7ba2b service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e3623867-97ff-4f5f-a1ec-427c0e534466 req-f1d84577-4819-492b-a293-15969dd7ba2b service nova] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e3623867-97ff-4f5f-a1ec-427c0e534466 req-f1d84577-4819-492b-a293-15969dd7ba2b service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e3623867-97ff-4f5f-a1ec-427c0e534466 req-f1d84577-4819-492b-a293-15969dd7ba2b service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.compute.manager [req-e3623867-97ff-4f5f-a1ec-427c0e534466 req-f1d84577-4819-492b-a293-15969dd7ba2b service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] No waiting events found dispatching network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:37 user nova-compute[74080]: WARNING nova.compute.manager [req-e3623867-97ff-4f5f-a1ec-427c0e534466 req-f1d84577-4819-492b-a293-15969dd7ba2b service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received unexpected event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 for instance with vm_state rescued and task_state None.
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.neutron [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updated VIF entry in instance network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG nova.network.neutron [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9026eeb8-4ac6-4276-8150-2669f9bc3c0a req-b3d55401-5d46-42dc-b114-b460a96693ce service nova] Releasing lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:38:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-b5900ef8-5223-4bbc-b74c-f1afe95ebce0 req-7842356a-9375-464c-9ffc-fdb3902c3012 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b5900ef8-5223-4bbc-b74c-f1afe95ebce0 req-7842356a-9375-464c-9ffc-fdb3902c3012 service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b5900ef8-5223-4bbc-b74c-f1afe95ebce0 req-7842356a-9375-464c-9ffc-fdb3902c3012 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b5900ef8-5223-4bbc-b74c-f1afe95ebce0 req-7842356a-9375-464c-9ffc-fdb3902c3012 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-b5900ef8-5223-4bbc-b74c-f1afe95ebce0 req-7842356a-9375-464c-9ffc-fdb3902c3012 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:39 user nova-compute[74080]: WARNING nova.compute.manager [req-b5900ef8-5223-4bbc-b74c-f1afe95ebce0 req-7842356a-9375-464c-9ffc-fdb3902c3012 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received unexpected event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with vm_state building and task_state spawning.
Oct 16 07:38:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-f1133bb7-0e0a-4a38-8aae-da0a95a6e51d req-cf743814-7a07-47d8-b8a2-f96a9a789848 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f1133bb7-0e0a-4a38-8aae-da0a95a6e51d req-cf743814-7a07-47d8-b8a2-f96a9a789848 service nova] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f1133bb7-0e0a-4a38-8aae-da0a95a6e51d req-cf743814-7a07-47d8-b8a2-f96a9a789848 service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f1133bb7-0e0a-4a38-8aae-da0a95a6e51d req-cf743814-7a07-47d8-b8a2-f96a9a789848 service nova] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-f1133bb7-0e0a-4a38-8aae-da0a95a6e51d req-cf743814-7a07-47d8-b8a2-f96a9a789848 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] No waiting events found dispatching network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:39 user nova-compute[74080]: WARNING nova.compute.manager [req-f1133bb7-0e0a-4a38-8aae-da0a95a6e51d req-cf743814-7a07-47d8-b8a2-f96a9a789848 service nova] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Received unexpected event network-vif-plugged-ddb9b43e-338c-42c6-a93b-80c3a638c387 for instance with vm_state rescued and task_state None.
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:40 user nova-compute[74080]: INFO nova.compute.manager [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Terminating instance
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.compute.manager [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:38:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Creating image(s)
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Ensure instance console log exists: /opt/stack/data/nova/instances/e936b802-720b-4d2a-9930-5e7b5244b2c8/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Start _get_guest_xml network_info=[{"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T07:37:05Z,direct_url=<?>,disk_format='qcow2',id=e1417b0e-b7e1-447f-9055-34f87f9be27e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-951456258',owner='c8b70039a31c47f39f7bf1b01b4e6e79',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T07:37:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '53e0aaee-216b-4783-ba2c-335350bed82f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxRfVdoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e936b802-720b-4d2a-9930-5e7b5244b2c8', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcf8fd1d-790f-4188-909c-e834e45a0ffc', 'serial': 'fcf8fd1d-790f-4188-909c-e834e45a0ffc'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "20599029-1071-4ef0-8e85-825634645311" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:40 user nova-compute[74080]: INFO nova.compute.manager [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Terminating instance
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:38:40 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:40 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T07:37:05Z,direct_url=<?>,disk_format='qcow2',id=e1417b0e-b7e1-447f-9055-34f87f9be27e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-951456258',owner='c8b70039a31c47f39f7bf1b01b4e6e79',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T07:37:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxRfVdoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:38:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:38:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:38:40 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:38:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0143b1a9-28db-48c2-b489-b9bf151a6b53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:38:40 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b17343-5ad8-42e7-b259-c273a7006110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc] added
Oct 16 07:38:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c358ef-d6d6-46cb-9913-d26d4ec976d9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3162c1-9a95-4ee9-ba61-20935c2d8581]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxRfVdoK {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PxRfVdoK" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd8fccc-1783-4ae2-8062-e8daf83344d7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PxRfVdoK'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf0a95-8a7b-403b-9573-63c35b618061]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3e4488-f06a-4641-82e0-76f3f1d8ef86]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:40 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:40 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:40 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:40 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-0b223203-d37e-470e-bb49-3c305ad14eeb req-6649bc17-d351-41d3-8adf-9d7195c4db1e service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-vif-unplugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0b223203-d37e-470e-bb49-3c305ad14eeb req-6649bc17-d351-41d3-8adf-9d7195c4db1e service nova] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0b223203-d37e-470e-bb49-3c305ad14eeb req-6649bc17-d351-41d3-8adf-9d7195c4db1e service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0b223203-d37e-470e-bb49-3c305ad14eeb req-6649bc17-d351-41d3-8adf-9d7195c4db1e service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-0b223203-d37e-470e-bb49-3c305ad14eeb req-6649bc17-d351-41d3-8adf-9d7195c4db1e service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] No waiting events found dispatching network-vif-unplugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-0b223203-d37e-470e-bb49-3c305ad14eeb req-6649bc17-d351-41d3-8adf-9d7195c4db1e service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-vif-unplugged-feb8314e-fc63-4c2a-ba40-139d9a84938d for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69d336-7cfd-4f5a-9d5e-d9f35ab18d4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260]
Oct 16 07:38:40 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260] successful.
Oct 16 07:38:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3112535-e40e-4926-b1e6-87831f3981eb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:38:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93775c2-dd16-465d-9822-f3424451d1be]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:41 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:41 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:41 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:38:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:38:41 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:38:41 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:38:41 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:38:41 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[674fdee1-cf9d-4ce5-a36b-3ed13a5f29fb]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance spawned successfully.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-81b587cc-5f1c-4270-914b-dcc3453310ac req-6c21ce34-017f-461e-9d29-af7b7d31df4e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-81b587cc-5f1c-4270-914b-dcc3453310ac req-6c21ce34-017f-461e-9d29-af7b7d31df4e service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-81b587cc-5f1c-4270-914b-dcc3453310ac req-6c21ce34-017f-461e-9d29-af7b7d31df4e service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-81b587cc-5f1c-4270-914b-dcc3453310ac req-6c21ce34-017f-461e-9d29-af7b7d31df4e service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-81b587cc-5f1c-4270-914b-dcc3453310ac req-6c21ce34-017f-461e-9d29-af7b7d31df4e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:41 user nova-compute[74080]: WARNING nova.compute.manager [req-81b587cc-5f1c-4270-914b-dcc3453310ac req-6c21ce34-017f-461e-9d29-af7b7d31df4e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received unexpected event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with vm_state building and task_state spawning.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Took 6.22 seconds to spawn the instance on the hypervisor.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.compute.manager [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Took 7.13 seconds to build instance.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4ad47c12-e607-4903-84cd-42f2bf727941 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.241s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Instance destroyed successfully.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lazy-loading 'resources' on Instance uuid 56ba6ebf-6771-4004-81b2-3f416ba0fb84 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 20599029-1071-4ef0-8e85-825634645311] Instance destroyed successfully.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'resources' on Instance uuid 20599029-1071-4ef0-8e85-825634645311 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-323399632',display_name='tempest-TestVolumeSwap-server-323399632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-323399632',id=16,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTgTwbJfdiSrsBexBHftLSBMdQDwwR4tgx8UseF2/sfJnZhxmCnQ0zOovueF1ah5hHLE/YJQsXtJZrvzjeDmghvgohG6WkjrB3PFMnEuEw5SXfs7SjbxBxUXZe3A2QHyw==',key_name='tempest-keypair-45346034',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:34:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5b90e1ba3d5457aa21d6ceb148ad7c4',ramdisk_id='',reservation_id='r-c305tszu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-196380766',owner_user_name='tempest-TestVolumeSwap-196380766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:34:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='205681b03ef0499498c2a4231fb10d46',uuid=56ba6ebf-6771-4004-81b2-3f416ba0fb84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Converting VIF {"id": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "address": "fa:16:3e:45:05:02", "network": {"id": "91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-788816245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5b90e1ba3d5457aa21d6ceb148ad7c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeb8314e-fc", "ovs_interfaceid": "feb8314e-fc63-4c2a-ba40-139d9a84938d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:05:02,bridge_name='br-int',has_traffic_filtering=True,id=feb8314e-fc63-4c2a-ba40-139d9a84938d,network=Network(91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb8314e-fc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_vif [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:05:02,bridge_name='br-int',has_traffic_filtering=True,id=feb8314e-fc63-4c2a-ba40-139d9a84938d,network=Network(91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb8314e-fc') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-345377541',display_name='tempest-AttachVolumeNegativeTest-server-345377541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-345377541',id=17,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ya7+WKxXigKuDepE1OCQ5+lphKZ+w9uehXRho0CNMOU1yfyC9M6o0vfqT6OrUFWmj94iEceSJVD7CNFH847vUPpsl1eQ8YbnMYzlD55VgY1ndFxeoby5zY+zrg9jDdw==',key_name='tempest-keypair-991718862',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-ay0fod50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=20599029-1071-4ef0-8e85-825634645311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "address": "fa:16:3e:6b:7e:2c", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4fae00c-84", "ovs_interfaceid": "c4fae00c-8441-49df-bed2-b7d61b1dac10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c4fae00c-8441-49df-bed2-b7d61b1dac10,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fae00c-84') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG os_vif [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c4fae00c-8441-49df-bed2-b7d61b1dac10,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fae00c-84') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeb8314e-fc, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4fae00c-84, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78e4b027-d11f-4783-9f78-2ab828404ee4) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=826c7db6-dea3-4cd1-90bf-fd5dbedd6b3f) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:41 user nova-compute[74080]: INFO os_vif [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:05:02,bridge_name='br-int',has_traffic_filtering=True,id=feb8314e-fc63-4c2a-ba40-139d9a84938d,network=Network(91ca3d2d-1415-4e0d-b5fb-20f8fe5e45d3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeb8314e-fc')
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Deleting instance files /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84_del
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Deletion of /opt/stack/data/nova/instances/56ba6ebf-6771-4004-81b2-3f416ba0fb84_del complete
Oct 16 07:38:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:41 user nova-compute[74080]: INFO os_vif [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7e:2c,bridge_name='br-int',has_traffic_filtering=True,id=c4fae00c-8441-49df-bed2-b7d61b1dac10,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4fae00c-84')
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Deleting instance files /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311_del
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Deletion of /opt/stack/data/nova/instances/20599029-1071-4ef0-8e85-825634645311_del complete
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.compute.manager [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Took 1.42 seconds to destroy the instance on the hypervisor.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:38:41 user nova-compute[74080]: INFO nova.compute.manager [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 20599029-1071-4ef0-8e85-825634645311] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 16 07:38:41 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 20599029-1071-4ef0-8e85-825634645311] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:38:41 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 20599029-1071-4ef0-8e85-825634645311] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxRfVdoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23131396330323739', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131396330323739', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1156738755',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1156738755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1156738755',id=24,image_ref='e1417b0e-b7e1-447f-9055-34f87f9be27e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtPDeELZsk4WwhURf6zsafnyE64My/JD/vJjjqNWHrRF8wgkHuP2CoAYw+uD57DwZYDZ4yQsZnldn+XPaHjpJYc2nU+sDaTsb+Ylr4OEtPyfQf24psc9B4TB25IOWH0ew==',key_name='tempest-keypair-1541947393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-g7r9ybxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-959199453',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33b58ae309d047548ebf29684db6037e',uuid=e936b802-720b-4d2a-9930-5e7b5244b2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ce:d2,bridge_name='br-int',has_traffic_filtering=True,id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dadda9b-6d') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.objects.instance [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'pci_devices' on Instance uuid e936b802-720b-4d2a-9930-5e7b5244b2c8 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:38:42 user nova-compute[74080]:   <uuid>e936b802-720b-4d2a-9930-5e7b5244b2c8</uuid>
Oct 16 07:38:42 user nova-compute[74080]:   <name>instance-00000018</name>
Oct 16 07:38:42 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:38:42 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:38:42 user nova-compute[74080]:   <metadata>
Oct 16 07:38:42 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:38:42 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:38:42 user nova-compute[74080]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1156738755</nova:name>
Oct 16 07:38:42 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:38:40</nova:creationTime>
Oct 16 07:38:42 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:38:42 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:38:42 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:38:42 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:38:42 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:38:42 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:38:42 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:38:42 user nova-compute[74080]:       <nova:owner>
Oct 16 07:38:42 user nova-compute[74080]:         <nova:user uuid="33b58ae309d047548ebf29684db6037e">tempest-TestVolumeBootPattern-959199453-project-member</nova:user>
Oct 16 07:38:42 user nova-compute[74080]:         <nova:project uuid="c8b70039a31c47f39f7bf1b01b4e6e79">tempest-TestVolumeBootPattern-959199453</nova:project>
Oct 16 07:38:42 user nova-compute[74080]:       </nova:owner>
Oct 16 07:38:42 user nova-compute[74080]:       <nova:root type="image" uuid="e1417b0e-b7e1-447f-9055-34f87f9be27e"/>
Oct 16 07:38:42 user nova-compute[74080]:       <nova:ports>
Oct 16 07:38:42 user nova-compute[74080]:         <nova:port uuid="1dadda9b-6dc1-433f-85c4-df2e0d7dcc41">
Oct 16 07:38:42 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:38:42 user nova-compute[74080]:         </nova:port>
Oct 16 07:38:42 user nova-compute[74080]:       </nova:ports>
Oct 16 07:38:42 user nova-compute[74080]:     </nova:instance>
Oct 16 07:38:42 user nova-compute[74080]:   </metadata>
Oct 16 07:38:42 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:38:42 user nova-compute[74080]:     <system>
Oct 16 07:38:42 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:38:42 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:38:42 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:38:42 user nova-compute[74080]:       <entry name="serial">e936b802-720b-4d2a-9930-5e7b5244b2c8</entry>
Oct 16 07:38:42 user nova-compute[74080]:       <entry name="uuid">e936b802-720b-4d2a-9930-5e7b5244b2c8</entry>
Oct 16 07:38:42 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:38:42 user nova-compute[74080]:     </system>
Oct 16 07:38:42 user nova-compute[74080]:   </sysinfo>
Oct 16 07:38:42 user nova-compute[74080]:   <os>
Oct 16 07:38:42 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:38:42 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:38:42 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:38:42 user nova-compute[74080]:   </os>
Oct 16 07:38:42 user nova-compute[74080]:   <features>
Oct 16 07:38:42 user nova-compute[74080]:     <acpi/>
Oct 16 07:38:42 user nova-compute[74080]:     <apic/>
Oct 16 07:38:42 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:38:42 user nova-compute[74080]:   </features>
Oct 16 07:38:42 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:38:42 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:38:42 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:38:42 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:38:42 user nova-compute[74080]:   </clock>
Oct 16 07:38:42 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:38:42 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:38:42 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:38:42 user nova-compute[74080]:   </cpu>
Oct 16 07:38:42 user nova-compute[74080]:   <devices>
Oct 16 07:38:42 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:38:42 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:38:42 user nova-compute[74080]:       <source dev="/dev/sdd"/>
Oct 16 07:38:42 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:38:42 user nova-compute[74080]:       <serial>fcf8fd1d-790f-4188-909c-e834e45a0ffc</serial>
Oct 16 07:38:42 user nova-compute[74080]:     </disk>
Oct 16 07:38:42 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:38:42 user nova-compute[74080]:       <mac address="fa:16:3e:a0:ce:d2"/>
Oct 16 07:38:42 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:38:42 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:38:42 user nova-compute[74080]:       <target dev="tap1dadda9b-6d"/>
Oct 16 07:38:42 user nova-compute[74080]:     </interface>
Oct 16 07:38:42 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:38:42 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/e936b802-720b-4d2a-9930-5e7b5244b2c8/console.log" append="off"/>
Oct 16 07:38:42 user nova-compute[74080]:     </serial>
Oct 16 07:38:42 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:38:42 user nova-compute[74080]:     <video>
Oct 16 07:38:42 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:38:42 user nova-compute[74080]:     </video>
Oct 16 07:38:42 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:38:42 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:38:42 user nova-compute[74080]:     </rng>
Oct 16 07:38:42 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:38:42 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:38:42 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:38:42 user nova-compute[74080]:     </memballoon>
Oct 16 07:38:42 user nova-compute[74080]:   </devices>
Oct 16 07:38:42 user nova-compute[74080]: </domain>
Oct 16 07:38:42 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1156738755',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1156738755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1156738755',id=24,image_ref='e1417b0e-b7e1-447f-9055-34f87f9be27e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtPDeELZsk4WwhURf6zsafnyE64My/JD/vJjjqNWHrRF8wgkHuP2CoAYw+uD57DwZYDZ4yQsZnldn+XPaHjpJYc2nU+sDaTsb+Ylr4OEtPyfQf24psc9B4TB25IOWH0ew==',key_name='tempest-keypair-1541947393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-g7r9ybxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-959199453',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33b58ae309d047548ebf29684db6037e',uuid=e936b802-720b-4d2a-9930-5e7b5244b2c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ce:d2,bridge_name='br-int',has_traffic_filtering=True,id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dadda9b-6d') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG os_vif [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ce:d2,bridge_name='br-int',has_traffic_filtering=True,id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dadda9b-6d') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28ee3a19-752e-5fd6-a601-5d6fb942e444', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dadda9b-6d, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dadda9b-6d, col_values=(('qos', UUID('e8f22f93-d395-43ab-9483-f401697a7bb6')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dadda9b-6d, col_values=(('external_ids', {'iface-id': '1dadda9b-6dc1-433f-85c4-df2e0d7dcc41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:ce:d2', 'vm-uuid': 'e936b802-720b-4d2a-9930-5e7b5244b2c8'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: INFO os_vif [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:ce:d2,bridge_name='br-int',has_traffic_filtering=True,id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dadda9b-6d')
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No VIF found with MAC fa:16:3e:a0:ce:d2, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Acquiring lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] No waiting events found dispatching network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:43 user nova-compute[74080]: WARNING nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received unexpected event network-vif-plugged-feb8314e-fc63-4c2a-ba40-139d9a84938d for instance with vm_state active and task_state deleting.
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-unplugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-unplugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-unplugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:43 user nova-compute[74080]: WARNING nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received unexpected event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with vm_state active and task_state deleting.
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:43 user nova-compute[74080]: WARNING nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received unexpected event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with vm_state active and task_state deleting.
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:43 user nova-compute[74080]: WARNING nova.compute.manager [req-e285d377-66d0-4a2e-b4d4-f77a12d5e206 req-345c5d29-038f-4155-8b3a-3e02ea64dc18 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received unexpected event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with vm_state active and task_state deleting.
Oct 16 07:38:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-de3bcc70-9af7-4aa3-be04-cc1557782792 req-580f9da1-6058-460c-817b-eba120a281c9 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-de3bcc70-9af7-4aa3-be04-cc1557782792 req-580f9da1-6058-460c-817b-eba120a281c9 service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-de3bcc70-9af7-4aa3-be04-cc1557782792 req-580f9da1-6058-460c-817b-eba120a281c9 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-de3bcc70-9af7-4aa3-be04-cc1557782792 req-580f9da1-6058-460c-817b-eba120a281c9 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-de3bcc70-9af7-4aa3-be04-cc1557782792 req-580f9da1-6058-460c-817b-eba120a281c9 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:43 user nova-compute[74080]: WARNING nova.compute.manager [req-de3bcc70-9af7-4aa3-be04-cc1557782792 req-580f9da1-6058-460c-817b-eba120a281c9 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received unexpected event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with vm_state building and task_state spawning.
Oct 16 07:38:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:44 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:44 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Took 2.31 seconds to deallocate network for instance.
Oct 16 07:38:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:44 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 20599029-1071-4ef0-8e85-825634645311] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:38:44 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 20599029-1071-4ef0-8e85-825634645311] Took 2.52 seconds to deallocate network for instance.
Oct 16 07:38:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:44 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:38:44 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:38:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.623s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.478s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:45 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Deleted allocations for instance 56ba6ebf-6771-4004-81b2-3f416ba0fb84
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-unplugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-unplugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:45 user nova-compute[74080]: WARNING nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received unexpected event network-vif-unplugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with vm_state deleted and task_state None.
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] Acquiring lock "20599029-1071-4ef0-8e85-825634645311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] Lock "20599029-1071-4ef0-8e85-825634645311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] No waiting events found dispatching network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:45 user nova-compute[74080]: WARNING nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received unexpected event network-vif-plugged-c4fae00c-8441-49df-bed2-b7d61b1dac10 for instance with vm_state deleted and task_state None.
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 56ba6ebf-6771-4004-81b2-3f416ba0fb84] Received event network-vif-deleted-feb8314e-fc63-4c2a-ba40-139d9a84938d {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-6ef6b2ac-ccb1-40e2-a6b2-0c00e001d5e6 req-ddadc713-699b-4bd3-95d7-bd65e4a1b0c1 service nova] [instance: 20599029-1071-4ef0-8e85-825634645311] Received event network-vif-deleted-c4fae00c-8441-49df-bed2-b7d61b1dac10 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-76e3b8f8-6507-4905-9f67-3aae860596fb tempest-TestVolumeSwap-196380766 tempest-TestVolumeSwap-196380766-project-member] Lock "56ba6ebf-6771-4004-81b2-3f416ba0fb84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.785s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:45 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Deleted allocations for instance 20599029-1071-4ef0-8e85-825634645311
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e4134961-e819-45c6-94ef-4bdcf3261856 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "20599029-1071-4ef0-8e85-825634645311" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.227s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-ef93acc7-4cb8-4f33-9801-aa0897c5bd17 req-be210ce2-8adf-41d5-97c2-cd44e1011080 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ef93acc7-4cb8-4f33-9801-aa0897c5bd17 req-be210ce2-8adf-41d5-97c2-cd44e1011080 service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ef93acc7-4cb8-4f33-9801-aa0897c5bd17 req-be210ce2-8adf-41d5-97c2-cd44e1011080 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ef93acc7-4cb8-4f33-9801-aa0897c5bd17 req-be210ce2-8adf-41d5-97c2-cd44e1011080 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-ef93acc7-4cb8-4f33-9801-aa0897c5bd17 req-be210ce2-8adf-41d5-97c2-cd44e1011080 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:38:45 user nova-compute[74080]: WARNING nova.compute.manager [req-ef93acc7-4cb8-4f33-9801-aa0897c5bd17 req-be210ce2-8adf-41d5-97c2-cd44e1011080 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received unexpected event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with vm_state building and task_state spawning.
Oct 16 07:38:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:38:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:38:46 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Instance spawned successfully.
Oct 16 07:38:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:38:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:38:46 user nova-compute[74080]: INFO nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Took 5.73 seconds to spawn the instance on the hypervisor.
Oct 16 07:38:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:38:46 user nova-compute[74080]: INFO nova.compute.manager [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Took 86.85 seconds to build instance.
Oct 16 07:38:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-52a65e4d-a128-411f-88a2-44b6b5282215 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 86.994s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:38:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:38:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:10 user nova-compute[74080]: INFO nova.compute.manager [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Detaching volume 82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:39:10 user nova-compute[74080]: INFO nova.virt.block_device [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Attempting to driver detach volume 82aa8960-04f1-4889-b389-ba67063042c9 from mountpoint /dev/vdb
Oct 16 07:39:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Attempting to detach device vdb from instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:39:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:39:10 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:39:10 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:39:10 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:39:10 user nova-compute[74080]:   <serial>82aa8960-04f1-4889-b389-ba67063042c9</serial>
Oct 16 07:39:10 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:39:10 user nova-compute[74080]: </disk>
Oct 16 07:39:10 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:39:10 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully detached device vdb from instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 from the persistent domain config.
Oct 16 07:39:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:39:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:39:10 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:39:10 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:39:10 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:39:10 user nova-compute[74080]:   <serial>82aa8960-04f1-4889-b389-ba67063042c9</serial>
Oct 16 07:39:10 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:39:10 user nova-compute[74080]: </disk>
Oct 16 07:39:10 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:39:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:39:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsBeMvib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:14 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed6366-c397-4951-90ef-787902add949]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:39:14 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8bf7d0-708c-46cd-9679-5a73942b6942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b] added
Oct 16 07:39:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aafcbf-b52f-4be3-8166-2f19b232316e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e941bd-67ae-4565-8174-99a9040aaa1f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsBeMvib {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsBeMvib" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd42b5-57e6-4b1d-948f-97d3d69597a7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsBeMvib'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8044b143-51cb-49d5-a090-169676f18646]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c577ede-cf0a-476c-88f8-bc9096270883]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:39:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Creating image(s)
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Ensure instance console log exists: /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Start _get_guest_xml network_info=[{"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '2e934665-80a5-4c2a-86bd-101362ef56b1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmFsvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a35de85-4095-4a93-8d33-a4577b960b95', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7981707-d7a7-4db0-bd60-4d86f01386c5', 'serial': 'e7981707-d7a7-4db0-bd60-4d86f01386c5'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a3bec-a508-4aeb-83be-50f0ac86e071]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]
Oct 16 07:39:14 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.
Oct 16 07:39:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmFsvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4545e020-7c8b-4fb9-9445-594cd39e2aaf]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7837465-8967-4c82-9510-47f70f809638]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:14 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a720a-a1c5-4edd-9df2-85e9f22dab66]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsBeMvib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:14 user nova-compute[74080]: INFO nova.compute.manager [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Detaching volume cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee
Oct 16 07:39:14 user nova-compute[74080]: INFO nova.virt.block_device [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Attempting to driver detach volume cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee from mountpoint /dev/vdb
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Attempting to detach device vdb from instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:39:14 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:39:14 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:39:14 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:39:14 user nova-compute[74080]:   <serial>cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee</serial>
Oct 16 07:39:14 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:39:14 user nova-compute[74080]: </disk>
Oct 16 07:39:14 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully detached device vdb from instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 from the persistent domain config.
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:39:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:39:14 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:39:14 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:39:14 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:39:14 user nova-compute[74080]:   <serial>cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee</serial>
Oct 16 07:39:14 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:39:14 user nova-compute[74080]: </disk>
Oct 16 07:39:14 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26131663436393736', 'path': '/dev/sde'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131663436393736', 'path': '/dev/sde'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.087s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:15 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:15 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG nova.objects.instance [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'flavor' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1b281b-7a9a-4ab3-83c3-98de95fe829d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:39:15 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:39:15 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:39:15 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:39:15 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:39:15 user nova-compute[74080]:   <serial>da228469-2aef-44ec-9590-4267470f6e1b</serial>
Oct 16 07:39:15 user nova-compute[74080]: </disk>
Oct 16 07:39:15 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780af2c-715f-4267-9be0-0d82ec1c390c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5] added
Oct 16 07:39:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d95ead-79aa-4cc3-badd-863f6496f33d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ad6cce-d11e-4758-bf4a-352abf1b81bb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzSmFsvt {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzSmFsvt" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c29e44-0f1e-4241-96fe-44740ce5f7c4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AzSmFsvt'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[95365787-35de-4512-b4c3-9f7cad2c5f53]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ddee6-7833-4cdf-95c8-52d5a15d01ec]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff519d-1036-4458-be1f-6cc1823fd6f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5, portal: 172.16.0.220,3260]
Oct 16 07:39:15 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5, portal: 172.16.0.220,3260] successful.
Oct 16 07:39:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[844f030a-becb-4dff-b0da-604602b8c499]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[126b6757-0e73-4958-8dbc-4fd6446dbc95]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:15 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:39:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd3f38d-ff19-4b28-8941-436990edf4e9]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmFsvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No VIF found with MAC fa:16:3e:71:ae:6a, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-63e8eab7-184a-4536-a99f-f2b7be64bd54 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 83.655s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] <== connect_volume: return (2479ms) {'type': 'block', 'scsi_wwn': '23065343266343766', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065343266343766', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1588867210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1588867210',id=26,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-9hl29b0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:38:20Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=5a35de85-4095-4a93-8d33-a4577b960b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:82:50,bridge_name='br-int',has_traffic_filtering=True,id=428a165b-6148-4fe5-a539-dad7bbb9a399,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428a165b-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:39:17 user nova-compute[74080]:   <uuid>5a35de85-4095-4a93-8d33-a4577b960b95</uuid>
Oct 16 07:39:17 user nova-compute[74080]:   <name>instance-0000001a</name>
Oct 16 07:39:17 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:39:17 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:39:17 user nova-compute[74080]:   <metadata>
Oct 16 07:39:17 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:39:17 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:39:17 user nova-compute[74080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1588867210</nova:name>
Oct 16 07:39:17 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:39:14</nova:creationTime>
Oct 16 07:39:17 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:39:17 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:39:17 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:39:17 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:39:17 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:39:17 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:39:17 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:39:17 user nova-compute[74080]:       <nova:owner>
Oct 16 07:39:17 user nova-compute[74080]:         <nova:user uuid="bf2fbffe5a5544dba338662d437d5ee2">tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member</nova:user>
Oct 16 07:39:17 user nova-compute[74080]:         <nova:project uuid="cea8d62574f84ae6a83ee19b7b03c21a">tempest-ServerBootFromVolumeStableRescueTest-1639701158</nova:project>
Oct 16 07:39:17 user nova-compute[74080]:       </nova:owner>
Oct 16 07:39:17 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:39:17 user nova-compute[74080]:       <nova:ports>
Oct 16 07:39:17 user nova-compute[74080]:         <nova:port uuid="428a165b-6148-4fe5-a539-dad7bbb9a399">
Oct 16 07:39:17 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 07:39:17 user nova-compute[74080]:         </nova:port>
Oct 16 07:39:17 user nova-compute[74080]:       </nova:ports>
Oct 16 07:39:17 user nova-compute[74080]:     </nova:instance>
Oct 16 07:39:17 user nova-compute[74080]:   </metadata>
Oct 16 07:39:17 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:39:17 user nova-compute[74080]:     <system>
Oct 16 07:39:17 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:39:17 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:39:17 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:39:17 user nova-compute[74080]:       <entry name="serial">5a35de85-4095-4a93-8d33-a4577b960b95</entry>
Oct 16 07:39:17 user nova-compute[74080]:       <entry name="uuid">5a35de85-4095-4a93-8d33-a4577b960b95</entry>
Oct 16 07:39:17 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:39:17 user nova-compute[74080]:     </system>
Oct 16 07:39:17 user nova-compute[74080]:   </sysinfo>
Oct 16 07:39:17 user nova-compute[74080]:   <os>
Oct 16 07:39:17 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:39:17 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:39:17 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:39:17 user nova-compute[74080]:   </os>
Oct 16 07:39:17 user nova-compute[74080]:   <features>
Oct 16 07:39:17 user nova-compute[74080]:     <acpi/>
Oct 16 07:39:17 user nova-compute[74080]:     <apic/>
Oct 16 07:39:17 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:39:17 user nova-compute[74080]:   </features>
Oct 16 07:39:17 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:39:17 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:39:17 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:39:17 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:39:17 user nova-compute[74080]:   </clock>
Oct 16 07:39:17 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:39:17 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:39:17 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:39:17 user nova-compute[74080]:   </cpu>
Oct 16 07:39:17 user nova-compute[74080]:   <devices>
Oct 16 07:39:17 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:39:17 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:39:17 user nova-compute[74080]:       <source dev="/dev/sdf"/>
Oct 16 07:39:17 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:39:17 user nova-compute[74080]:       <serial>e7981707-d7a7-4db0-bd60-4d86f01386c5</serial>
Oct 16 07:39:17 user nova-compute[74080]:     </disk>
Oct 16 07:39:17 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:39:17 user nova-compute[74080]:       <mac address="fa:16:3e:f1:82:50"/>
Oct 16 07:39:17 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:39:17 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:39:17 user nova-compute[74080]:       <target dev="tap428a165b-61"/>
Oct 16 07:39:17 user nova-compute[74080]:     </interface>
Oct 16 07:39:17 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:39:17 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/console.log" append="off"/>
Oct 16 07:39:17 user nova-compute[74080]:     </serial>
Oct 16 07:39:17 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:39:17 user nova-compute[74080]:     <video>
Oct 16 07:39:17 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:39:17 user nova-compute[74080]:     </video>
Oct 16 07:39:17 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:39:17 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:39:17 user nova-compute[74080]:     </rng>
Oct 16 07:39:17 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:39:17 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:39:17 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:39:17 user nova-compute[74080]:     </memballoon>
Oct 16 07:39:17 user nova-compute[74080]:   </devices>
Oct 16 07:39:17 user nova-compute[74080]: </domain>
Oct 16 07:39:17 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1588867210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1588867210',id=26,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-9hl29b0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:38:20Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=5a35de85-4095-4a93-8d33-a4577b960b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:82:50,bridge_name='br-int',has_traffic_filtering=True,id=428a165b-6148-4fe5-a539-dad7bbb9a399,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428a165b-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG os_vif [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:82:50,bridge_name='br-int',has_traffic_filtering=True,id=428a165b-6148-4fe5-a539-dad7bbb9a399,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428a165b-61') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29ad7f93-35e2-58c1-9af2-38f7290a8aa6', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap428a165b-61, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap428a165b-61, col_values=(('qos', UUID('b005fbb3-66c6-4f51-a7cf-16b4e34c0413')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap428a165b-61, col_values=(('external_ids', {'iface-id': '428a165b-6148-4fe5-a539-dad7bbb9a399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:82:50', 'vm-uuid': '5a35de85-4095-4a93-8d33-a4577b960b95'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:17 user nova-compute[74080]: INFO os_vif [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:82:50,bridge_name='br-int',has_traffic_filtering=True,id=428a165b-6148-4fe5-a539-dad7bbb9a399,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428a165b-61')
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No VIF found with MAC fa:16:3e:f1:82:50, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:39:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updating instance_info_cache with network_info: [{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-79c5d316-69ae-4d97-a6ef-b41aeb67b2b5 req-9cc9fc6b-1fdc-46b7-bd49-28e80862cb06 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-79c5d316-69ae-4d97-a6ef-b41aeb67b2b5 req-9cc9fc6b-1fdc-46b7-bd49-28e80862cb06 service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-79c5d316-69ae-4d97-a6ef-b41aeb67b2b5 req-9cc9fc6b-1fdc-46b7-bd49-28e80862cb06 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-79c5d316-69ae-4d97-a6ef-b41aeb67b2b5 req-9cc9fc6b-1fdc-46b7-bd49-28e80862cb06 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-79c5d316-69ae-4d97-a6ef-b41aeb67b2b5 req-9cc9fc6b-1fdc-46b7-bd49-28e80862cb06 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:19 user nova-compute[74080]: WARNING nova.compute.manager [req-79c5d316-69ae-4d97-a6ef-b41aeb67b2b5 req-9cc9fc6b-1fdc-46b7-bd49-28e80862cb06 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state building and task_state spawning.
Oct 16 07:39:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:39:20 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance spawned successfully.
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:20 user nova-compute[74080]: INFO nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Took 6.45 seconds to spawn the instance on the hypervisor.
Oct 16 07:39:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:39:21 user nova-compute[74080]: INFO nova.compute.manager [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Took 61.53 seconds to build instance.
Oct 16 07:39:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-3d87086f-0273-4711-8d37-0bff3f7419a2 req-e02b56da-37b6-4809-ae22-c1a429b9c822 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3d87086f-0273-4711-8d37-0bff3f7419a2 req-e02b56da-37b6-4809-ae22-c1a429b9c822 service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3d87086f-0273-4711-8d37-0bff3f7419a2 req-e02b56da-37b6-4809-ae22-c1a429b9c822 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3d87086f-0273-4711-8d37-0bff3f7419a2 req-e02b56da-37b6-4809-ae22-c1a429b9c822 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-3d87086f-0273-4711-8d37-0bff3f7419a2 req-e02b56da-37b6-4809-ae22-c1a429b9c822 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:21 user nova-compute[74080]: WARNING nova.compute.manager [req-3d87086f-0273-4711-8d37-0bff3f7419a2 req-e02b56da-37b6-4809-ae22-c1a429b9c822 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state active and task_state None.
Oct 16 07:39:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2b109a4a-a484-46ec-8f0a-95541faafb91 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "5a35de85-4095-4a93-8d33-a4577b960b95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 61.675s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:22 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7083MB free_disk=25.272563934326172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e936b802-720b-4d2a-9930-5e7b5244b2c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d78e592d-691e-4fa1-9840-8f436fa17f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:28 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing instance network info cache due to event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updated VIF entry in instance network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-366d453d-8f19-4998-909f-9c8621a1c83a req-5833a94d-12ec-4801-a087-366af753627f service nova] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:39:30 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 is timed out.
Oct 16 07:39:30 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully detached device vdb from instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 from the live domain config.
Oct 16 07:39:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scNoyrUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:30 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7055082d-c4a1-4e04-ae53-5e2df16af617]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:39:30 user nova-compute[74080]: No targets found.
Oct 16 07:39:30 user nova-compute[74080]: iSNS:
Oct 16 07:39:30 user nova-compute[74080]: No targets found.
Oct 16 07:39:30 user nova-compute[74080]: STATIC:
Oct 16 07:39:30 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:39:30 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:30 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:30 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9
Oct 16 07:39:30 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:30 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:30 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc
Oct 16 07:39:30 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:30 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:30 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:39:30 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:30 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:30 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee
Oct 16 07:39:30 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:30 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:30 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:39:30 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:30 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:30 user nova-compute[74080]: FIRMWARE:
Oct 16 07:39:30 user nova-compute[74080]: No targets found.
Oct 16 07:39:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:39:30 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:39:30 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5592d143-5c15-4406-ab96-e138bf4eef58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ef476-c0a2-4bb5-a25b-5818a51c9af2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:30 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7c43bc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9'): ({'sdb'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Removing single pathed devices sdb {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[479640b6-c14d-4eb6-a81f-9466a5867e5c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc382837-e759-4628-a55f-600d51965983]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flushing IO for device /dev/sdb {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79633db-500a-464c-a16c-955752e908b9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ecbfd6-8cb1-48c7-bc86-0f850e5a918e]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb80b9d-05bd-471a-934f-ac5895fb992f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b188cf-a308-4558-adea-39ca12d29c25]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260]
Oct 16 07:39:31 user nova-compute[74080]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9, portal: 172.16.0.220,3260] successful.
Oct 16 07:39:31 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82aa8960-04f1-4889-b389-ba67063042c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[652cf6d2-8e63-447d-b827-d08988eba12c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== disconnect_volume: return (374ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 07:39:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] There are 0 instances to clean {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing instance network info cache due to event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG nova.network.neutron [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG nova.objects.instance [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-305a26e4-ea9a-4ff2-9555-e6810098b960 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.031s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG nova.network.neutron [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updated VIF entry in instance network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG nova.network.neutron [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c0a34c6-54a5-4b0e-9113-956c32036765 req-7c697073-a636-4131-b3b6-7eb71d7d09f5 service nova] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:39:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-58acd7eb-3838-41bd-bbb0-82f90d364c1c tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-58acd7eb-3838-41bd-bbb0-82f90d364c1c tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-58acd7eb-3838-41bd-bbb0-82f90d364c1c tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-58acd7eb-3838-41bd-bbb0-82f90d364c1c tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74080) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG nova.objects.instance [None req-58acd7eb-3838-41bd-bbb0-82f90d364c1c tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:33 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance destroyed successfully.
Oct 16 07:39:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-58acd7eb-3838-41bd-bbb0-82f90d364c1c tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-58acd7eb-3838-41bd-bbb0-82f90d364c1c tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.990s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:34 user nova-compute[74080]: WARNING nova.compute.manager [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state stopped and task_state None.
Oct 16 07:39:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:34 user nova-compute[74080]: WARNING nova.compute.manager [req-28bb3080-aa01-45d2-b8ff-80b890f62fe7 req-c3a996a7-f925-472c-973a-26dfef029985 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state stopped and task_state None.
Oct 16 07:39:35 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 is timed out.
Oct 16 07:39:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully detached device vdb from instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 from the live domain config.
Oct 16 07:39:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'napoxlCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:35 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b880ab4e-2ea4-46f6-95eb-e426a15232fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:39:35 user nova-compute[74080]: No targets found.
Oct 16 07:39:35 user nova-compute[74080]: iSNS:
Oct 16 07:39:35 user nova-compute[74080]: No targets found.
Oct 16 07:39:35 user nova-compute[74080]: STATIC:
Oct 16 07:39:35 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:39:35 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:35 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:35 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc
Oct 16 07:39:35 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:35 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:35 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:39:35 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:35 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:35 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee
Oct 16 07:39:35 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:35 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:35 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:39:35 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:35 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:35 user nova-compute[74080]: FIRMWARE:
Oct 16 07:39:35 user nova-compute[74080]: No targets found.
Oct 16 07:39:35 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:39:35 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:39:35 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12645811-19d6-43a3-8d43-8d26e54e298d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c1a1d-0f6a-4d3c-be65-27b0c415c077]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:35 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:35 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:35 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac7bca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee'): ({'sdg'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Removing single pathed devices sdg {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb32a075-54ff-4ba9-9f7c-58df2a1537da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be4ead-2cc5-462d-a2d3-44ee8d560405]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Flushing IO for device /dev/sdg {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6024e5-4953-437a-bcd1-13f9b36f3b26]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea934474-467b-4a6d-a309-2d166a3767fe]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a404d7-1252-4bfb-8181-731780bf7ee1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca2ba41-d080-418d-b583-ca4a019158c2]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260]
Oct 16 07:39:35 user nova-compute[74080]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee, portal: 172.16.0.220,3260] successful.
Oct 16 07:39:35 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5081929c-1b4f-4f4f-ae86-d1f260bc313a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== disconnect_volume: return (362ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:39:36 user nova-compute[74080]: INFO nova.compute.claims [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Claim successful on node user
Oct 16 07:39:36 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:39:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:39:36 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.policy [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbfbcc052d274a2b85276bf7c12e8233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998dad27b18a4a15a4563815aa57cb72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:39:37 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Creating image(s)
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "/opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "/opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk 1073741824" returned: 0 in 0.061s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Cannot resize image /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Ensure instance console log exists: /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-changed-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Refreshing instance network info cache due to event network-changed-e8c3048c-e1f4-4b03-86cc-eb194060a682. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] Acquiring lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] Acquired lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG nova.network.neutron [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Refreshing network info cache for port e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Successfully created port: 84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:38 user nova-compute[74080]: DEBUG nova.objects.instance [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'flavor' on Instance uuid d78e592d-691e-4fa1-9840-8f436fa17f0d {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.neutron [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updated VIF entry in instance network info cache for port e8c3048c-e1f4-4b03-86cc-eb194060a682. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.neutron [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updating instance_info_cache with network_info: [{"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd527d9d-52e0-4e3a-9940-8047144dbefb req-58461fdf-4e84-4ce5-abed-b5a48b97dec3 service nova] Releasing lock "refresh_cache-d78e592d-691e-4fa1-9840-8f436fa17f0d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:39 user nova-compute[74080]: INFO nova.compute.manager [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Attaching volume 6c3a1050-fb68-46fe-b2e0-d6d6eb03938d to /dev/vdb
Oct 16 07:39:39 user nova-compute[74080]: DEBUG os_brick.utils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb257346-67da-4cf0-82f5-c16aa9652efc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea229aec-06c2-47bb-b848-7481268c8d38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[034d800f-3ada-4593-b080-eb36e1f7f8ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb1d6b2-4122-44e9-960c-aa20203c0a9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:39:39 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0836852-4821-49ae-b9b1-353ccfe49ef6]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG os_brick.utils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updating existing volume attachment record: 634ff189-1cc3-4647-ae6b-282ab5f0a3a6 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Successfully updated port: 84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquired lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Updating instance_info_cache with network_info: [{"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Releasing lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Instance network_info: |[{"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Start _get_guest_xml network_info=[{"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:39:39 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:39 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-557770387',display_name='tempest-AttachVolumeNegativeTest-server-557770387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-557770387',id=28,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAlrIjQMnTXqnzcZlGuRZB6Lc+F9ebBVpVI4+Q9RwaiiTYGYW7ArXgVBEdk6EagZNOgCZMwQbq1oLjUQwAiYdel8G679LWB/wQkF4GTvsbe+3gpsCA9jflAC3+6rj/hug==',key_name='tempest-keypair-973926211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-wef1007y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=84c948a4-99bd-4493-acd7-c5b45d3211c3,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c948a4-99') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.objects.instance [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'pci_devices' on Instance uuid 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:39:39 user nova-compute[74080]:   <uuid>64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c</uuid>
Oct 16 07:39:39 user nova-compute[74080]:   <name>instance-0000001c</name>
Oct 16 07:39:39 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:39:39 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:39:39 user nova-compute[74080]:   <metadata>
Oct 16 07:39:39 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:39:39 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:39:39 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeNegativeTest-server-557770387</nova:name>
Oct 16 07:39:39 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:39:39</nova:creationTime>
Oct 16 07:39:39 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:39:39 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:39:39 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:39:39 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:39:39 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:39:39 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:39:39 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:39:39 user nova-compute[74080]:       <nova:owner>
Oct 16 07:39:39 user nova-compute[74080]:         <nova:user uuid="bbfbcc052d274a2b85276bf7c12e8233">tempest-AttachVolumeNegativeTest-1751015165-project-member</nova:user>
Oct 16 07:39:39 user nova-compute[74080]:         <nova:project uuid="998dad27b18a4a15a4563815aa57cb72">tempest-AttachVolumeNegativeTest-1751015165</nova:project>
Oct 16 07:39:39 user nova-compute[74080]:       </nova:owner>
Oct 16 07:39:39 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:39:39 user nova-compute[74080]:       <nova:ports>
Oct 16 07:39:39 user nova-compute[74080]:         <nova:port uuid="84c948a4-99bd-4493-acd7-c5b45d3211c3">
Oct 16 07:39:39 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 07:39:39 user nova-compute[74080]:         </nova:port>
Oct 16 07:39:39 user nova-compute[74080]:       </nova:ports>
Oct 16 07:39:39 user nova-compute[74080]:     </nova:instance>
Oct 16 07:39:39 user nova-compute[74080]:   </metadata>
Oct 16 07:39:39 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:39:39 user nova-compute[74080]:     <system>
Oct 16 07:39:39 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:39:39 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:39:39 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:39:39 user nova-compute[74080]:       <entry name="serial">64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c</entry>
Oct 16 07:39:39 user nova-compute[74080]:       <entry name="uuid">64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c</entry>
Oct 16 07:39:39 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:39:39 user nova-compute[74080]:     </system>
Oct 16 07:39:39 user nova-compute[74080]:   </sysinfo>
Oct 16 07:39:39 user nova-compute[74080]:   <os>
Oct 16 07:39:39 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:39:39 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:39:39 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:39:39 user nova-compute[74080]:   </os>
Oct 16 07:39:39 user nova-compute[74080]:   <features>
Oct 16 07:39:39 user nova-compute[74080]:     <acpi/>
Oct 16 07:39:39 user nova-compute[74080]:     <apic/>
Oct 16 07:39:39 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:39:39 user nova-compute[74080]:   </features>
Oct 16 07:39:39 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:39:39 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:39:39 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:39:39 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:39:39 user nova-compute[74080]:   </clock>
Oct 16 07:39:39 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:39:39 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:39:39 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:39:39 user nova-compute[74080]:   </cpu>
Oct 16 07:39:39 user nova-compute[74080]:   <devices>
Oct 16 07:39:39 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:39:39 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:39:39 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk"/>
Oct 16 07:39:39 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:39:39 user nova-compute[74080]:     </disk>
Oct 16 07:39:39 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:39:39 user nova-compute[74080]:       <mac address="fa:16:3e:59:e2:db"/>
Oct 16 07:39:39 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:39:39 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:39:39 user nova-compute[74080]:       <target dev="tap84c948a4-99"/>
Oct 16 07:39:39 user nova-compute[74080]:     </interface>
Oct 16 07:39:39 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:39:39 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/console.log" append="off"/>
Oct 16 07:39:39 user nova-compute[74080]:     </serial>
Oct 16 07:39:39 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:39:39 user nova-compute[74080]:     <video>
Oct 16 07:39:39 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:39:39 user nova-compute[74080]:     </video>
Oct 16 07:39:39 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:39:39 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:39:39 user nova-compute[74080]:     </rng>
Oct 16 07:39:39 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:39:39 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:39:39 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:39:39 user nova-compute[74080]:     </memballoon>
Oct 16 07:39:39 user nova-compute[74080]:   </devices>
Oct 16 07:39:39 user nova-compute[74080]: </domain>
Oct 16 07:39:39 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-557770387',display_name='tempest-AttachVolumeNegativeTest-server-557770387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-557770387',id=28,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAlrIjQMnTXqnzcZlGuRZB6Lc+F9ebBVpVI4+Q9RwaiiTYGYW7ArXgVBEdk6EagZNOgCZMwQbq1oLjUQwAiYdel8G679LWB/wQkF4GTvsbe+3gpsCA9jflAC3+6rj/hug==',key_name='tempest-keypair-973926211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-wef1007y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:39:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=84c948a4-99bd-4493-acd7-c5b45d3211c3,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c948a4-99') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG os_vif [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=84c948a4-99bd-4493-acd7-c5b45d3211c3,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c948a4-99') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '378dfdd8-184e-5ae2-b689-8c5e6e84b80c', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c948a4-99, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84c948a4-99, col_values=(('qos', UUID('ca2a85ee-01ff-4737-8315-557ce122fac5')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84c948a4-99, col_values=(('external_ids', {'iface-id': '84c948a4-99bd-4493-acd7-c5b45d3211c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:e2:db', 'vm-uuid': '64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:40 user nova-compute[74080]: INFO os_vif [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=84c948a4-99bd-4493-acd7-c5b45d3211c3,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c948a4-99')
Oct 16 07:39:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No VIF found with MAC fa:16:3e:59:e2:db, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-changed-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Refreshing instance network info cache due to event network-changed-84c948a4-99bd-4493-acd7-c5b45d3211c3. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] Acquiring lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] Acquired lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG nova.network.neutron [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Refreshing network info cache for port 84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG nova.network.neutron [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Updated VIF entry in instance network info cache for port 84c948a4-99bd-4493-acd7-c5b45d3211c3. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG nova.network.neutron [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Updating instance_info_cache with network_info: [{"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b3aa5b6e-163b-4b2d-b4e4-6b678f57dae3 req-5100cad2-5a49-4ac7-929d-76ef1169842c service nova] Releasing lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:39:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-26e0adae-d26a-4ec7-b611-8b892362c142 req-98a3bcd1-8c02-4fc1-abb5-65d1a0fe27a8 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-26e0adae-d26a-4ec7-b611-8b892362c142 req-98a3bcd1-8c02-4fc1-abb5-65d1a0fe27a8 service nova] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-26e0adae-d26a-4ec7-b611-8b892362c142 req-98a3bcd1-8c02-4fc1-abb5-65d1a0fe27a8 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-26e0adae-d26a-4ec7-b611-8b892362c142 req-98a3bcd1-8c02-4fc1-abb5-65d1a0fe27a8 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-26e0adae-d26a-4ec7-b611-8b892362c142 req-98a3bcd1-8c02-4fc1-abb5-65d1a0fe27a8 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] No waiting events found dispatching network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:42 user nova-compute[74080]: WARNING nova.compute.manager [req-26e0adae-d26a-4ec7-b611-8b892362c142 req-98a3bcd1-8c02-4fc1-abb5-65d1a0fe27a8 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received unexpected event network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 for instance with vm_state building and task_state spawning.
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG nova.objects.instance [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'flavor' on Instance uuid 7dbb5b31-5a8a-474f-91ae-642a9019fd10 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d70919be-83a0-4b3e-a326-5c1e1f96b55b tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.699s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 27.547s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:42 user nova-compute[74080]: INFO nova.compute.manager [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Terminating instance
Oct 16 07:39:42 user nova-compute[74080]: DEBUG nova.compute.manager [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-2905ab8e-fa3a-4ef0-9e43-f31f5260206f req-145892ab-4261-44f3-88be-ff59b1ab6189 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-vif-unplugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2905ab8e-fa3a-4ef0-9e43-f31f5260206f req-145892ab-4261-44f3-88be-ff59b1ab6189 service nova] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2905ab8e-fa3a-4ef0-9e43-f31f5260206f req-145892ab-4261-44f3-88be-ff59b1ab6189 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2905ab8e-fa3a-4ef0-9e43-f31f5260206f req-145892ab-4261-44f3-88be-ff59b1ab6189 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-2905ab8e-fa3a-4ef0-9e43-f31f5260206f req-145892ab-4261-44f3-88be-ff59b1ab6189 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] No waiting events found dispatching network-vif-unplugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-2905ab8e-fa3a-4ef0-9e43-f31f5260206f req-145892ab-4261-44f3-88be-ff59b1ab6189 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-vif-unplugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:39:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Instance destroyed successfully.
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.objects.instance [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'resources' on Instance uuid 7dbb5b31-5a8a-474f-91ae-642a9019fd10 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-587662913',display_name='tempest-VolumesSnapshotTestJSON-instance-587662913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-587662913',id=20,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMPVnDaMpYPuTOtyR6/LWkxarJjeBPUS0zEJjk/wk5s9R2D/j8jslDl/J7ajJpUgdcyep1wwiYm/ZNPO/5NsBAFVuY6VN31IWpE+nIeTQ0gKcRXsfitMHoLSHpu76zckQ==',key_name='tempest-keypair-316658904',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:35:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dbb580495c34728bb3d06e92842737d',ramdisk_id='',reservation_id='r-3p7w0w0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-389413629',owner_user_name='tempest-VolumesSnapshotTestJSON-389413629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:35:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69562ed193c74ec0815d41cbe9b662c1',uuid=7dbb5b31-5a8a-474f-91ae-642a9019fd10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converting VIF {"id": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "address": "fa:16:3e:aa:29:4d", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e11b12-f0", "ovs_interfaceid": "20e11b12-f03f-4785-b0ed-e879fed63fe1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:29:4d,bridge_name='br-int',has_traffic_filtering=True,id=20e11b12-f03f-4785-b0ed-e879fed63fe1,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e11b12-f0') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_vif [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:29:4d,bridge_name='br-int',has_traffic_filtering=True,id=20e11b12-f03f-4785-b0ed-e879fed63fe1,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e11b12-f0') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20e11b12-f0, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14f2033f-0dc3-4857-9274-0964ec034a15) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:43 user nova-compute[74080]: INFO os_vif [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:29:4d,bridge_name='br-int',has_traffic_filtering=True,id=20e11b12-f03f-4785-b0ed-e879fed63fe1,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e11b12-f0')
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'napoxlCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:43 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dbf5ec-9bdf-4278-8bab-b525ad3cca86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:39:43 user nova-compute[74080]: No targets found.
Oct 16 07:39:43 user nova-compute[74080]: iSNS:
Oct 16 07:39:43 user nova-compute[74080]: No targets found.
Oct 16 07:39:43 user nova-compute[74080]: STATIC:
Oct 16 07:39:43 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:39:43 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:43 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:43 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc
Oct 16 07:39:43 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:43 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:43 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:39:43 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:43 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:43 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:39:43 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:43 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:43 user nova-compute[74080]: FIRMWARE:
Oct 16 07:39:43 user nova-compute[74080]: No targets found.
Oct 16 07:39:43 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:39:43 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:39:43 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf501c31-fb84-4e8f-8d9a-280d1c4bc4ee', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fb7094-57a3-41e0-b0ab-49b8cb7c96a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5100e3c-a4cb-4476-97d5-20db90a73cf6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:43 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:43 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:43 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:43 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:43 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:43 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:43 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:43 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7cd593eb0>, {}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Disconnecting from: [] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.103s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== disconnect_volume: return (104ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:39:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Deleting instance files /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10_del
Oct 16 07:39:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Deletion of /opt/stack/data/nova/instances/7dbb5b31-5a8a-474f-91ae-642a9019fd10_del complete
Oct 16 07:39:43 user nova-compute[74080]: INFO nova.compute.manager [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 16 07:39:43 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:39:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Instance spawned successfully.
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:39:44 user nova-compute[74080]: INFO nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Took 6.86 seconds to spawn the instance on the hypervisor.
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:39:44 user nova-compute[74080]: INFO nova.compute.manager [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Took 7.88 seconds to build instance.
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8538c81a-87d5-40a1-980c-694fa66ba8fb tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.980s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-39ce8b0c-1486-442c-a3ba-13773e76d9b1 req-058451e7-a24d-4132-b87a-71c5f87c14b7 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-39ce8b0c-1486-442c-a3ba-13773e76d9b1 req-058451e7-a24d-4132-b87a-71c5f87c14b7 service nova] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-39ce8b0c-1486-442c-a3ba-13773e76d9b1 req-058451e7-a24d-4132-b87a-71c5f87c14b7 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-39ce8b0c-1486-442c-a3ba-13773e76d9b1 req-058451e7-a24d-4132-b87a-71c5f87c14b7 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-39ce8b0c-1486-442c-a3ba-13773e76d9b1 req-058451e7-a24d-4132-b87a-71c5f87c14b7 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] No waiting events found dispatching network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:44 user nova-compute[74080]: WARNING nova.compute.manager [req-39ce8b0c-1486-442c-a3ba-13773e76d9b1 req-058451e7-a24d-4132-b87a-71c5f87c14b7 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received unexpected event network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 for instance with vm_state active and task_state None.
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:44 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Took 0.89 seconds to deallocate network for instance.
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-13f8ef7e-9cf2-435e-a270-8ab722ecea9f req-b07a21e0-f96c-4c23-9e0b-330054ffdd34 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-vif-deleted-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:44 user nova-compute[74080]: INFO nova.compute.manager [req-13f8ef7e-9cf2-435e-a270-8ab722ecea9f req-b07a21e0-f96c-4c23-9e0b-330054ffdd34 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Neutron deleted interface 20e11b12-f03f-4785-b0ed-e879fed63fe1; detaching it from the instance and deleting it from the info cache
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-13f8ef7e-9cf2-435e-a270-8ab722ecea9f req-b07a21e0-f96c-4c23-9e0b-330054ffdd34 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-13f8ef7e-9cf2-435e-a270-8ab722ecea9f req-b07a21e0-f96c-4c23-9e0b-330054ffdd34 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Detach interface failed, port_id=20e11b12-f03f-4785-b0ed-e879fed63fe1, reason: Instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:39:44 user nova-compute[74080]: WARNING nova.volume.cinder [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Attachment b41b83ee-6a1c-4185-96ec-4ad50ec74dc0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b41b83ee-6a1c-4185-96ec-4ad50ec74dc0. (HTTP 404) (Request-ID: req-8a3ff91d-8456-4861-b193-01ee2bbb088a)
Oct 16 07:39:44 user nova-compute[74080]: INFO nova.compute.manager [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Took 0.04 seconds to detach 1 volumes for instance.
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-546dfe7d-1b18-4089-be52-a137eebe1465 req-902644d0-61a9-495c-93af-b907b6fa6a35 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received event network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-546dfe7d-1b18-4089-be52-a137eebe1465 req-902644d0-61a9-495c-93af-b907b6fa6a35 service nova] Acquiring lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-546dfe7d-1b18-4089-be52-a137eebe1465 req-902644d0-61a9-495c-93af-b907b6fa6a35 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-546dfe7d-1b18-4089-be52-a137eebe1465 req-902644d0-61a9-495c-93af-b907b6fa6a35 service nova] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-546dfe7d-1b18-4089-be52-a137eebe1465 req-902644d0-61a9-495c-93af-b907b6fa6a35 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] No waiting events found dispatching network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:44 user nova-compute[74080]: WARNING nova.compute.manager [req-546dfe7d-1b18-4089-be52-a137eebe1465 req-902644d0-61a9-495c-93af-b907b6fa6a35 service nova] [instance: 7dbb5b31-5a8a-474f-91ae-642a9019fd10] Received unexpected event network-vif-plugged-20e11b12-f03f-4785-b0ed-e879fed63fe1 for instance with vm_state deleted and task_state None.
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:39:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:45 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Deleted allocations for instance 7dbb5b31-5a8a-474f-91ae-642a9019fd10
Oct 16 07:39:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-045205ed-4613-47d7-9807-838f1b494d2a tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "7dbb5b31-5a8a-474f-91ae-642a9019fd10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:51 user nova-compute[74080]: INFO nova.compute.manager [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Rebooting instance
Oct 16 07:39:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG nova.network.neutron [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG nova.network.neutron [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG nova.compute.manager [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-1d667f49-8210-430b-9e77-bf36c6f4fca6 req-efbfae85-47f2-4b21-a7de-671fc2245872 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-unplugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1d667f49-8210-430b-9e77-bf36c6f4fca6 req-efbfae85-47f2-4b21-a7de-671fc2245872 service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1d667f49-8210-430b-9e77-bf36c6f4fca6 req-efbfae85-47f2-4b21-a7de-671fc2245872 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1d667f49-8210-430b-9e77-bf36c6f4fca6 req-efbfae85-47f2-4b21-a7de-671fc2245872 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-1d667f49-8210-430b-9e77-bf36c6f4fca6 req-efbfae85-47f2-4b21-a7de-671fc2245872 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-unplugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:52 user nova-compute[74080]: WARNING nova.compute.manager [req-1d667f49-8210-430b-9e77-bf36c6f4fca6 req-efbfae85-47f2-4b21-a7de-671fc2245872 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received unexpected event network-vif-unplugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 07:39:52 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance destroyed successfully.
Oct 16 07:39:52 user nova-compute[74080]: DEBUG nova.objects.instance [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'resources' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-293706194',display_name='tempest-TestMinimumBasicScenario-server-293706194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-293706194',id=21,image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HgaFzgT16PzViw2GUVBuCQPdZZAN2aJww3qG+wrjc0AB73ZDIFZ3GmBtwMglULbpdFjnprQLUiVvJqKWNNuIihlQ3mFyqoF9NZYtc5BfEv0ZlEub7B4odRbPJ/b/ocQ==',key_name='tempest-TestMinimumBasicScenario-871128063',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-bi7weth5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:39:52Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=d2f1f6a7-9bf5-4542-8408-d634e25bbd66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_vif [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4255ae13-23, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42738df1-7e86-47c1-9c23-d53ad6cdb2bb) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:52 user nova-compute[74080]: INFO os_vif [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23')
Oct 16 07:39:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsBeMvib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:52 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49e0fae-fd69-42d2-9cca-c4210678173a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:39:52 user nova-compute[74080]: No targets found.
Oct 16 07:39:52 user nova-compute[74080]: iSNS:
Oct 16 07:39:52 user nova-compute[74080]: No targets found.
Oct 16 07:39:52 user nova-compute[74080]: STATIC:
Oct 16 07:39:52 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:39:52 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:52 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:52 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc
Oct 16 07:39:52 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:52 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:52 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:39:52 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:52 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:52 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:39:52 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:39:52 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:39:52 user nova-compute[74080]: FIRMWARE:
Oct 16 07:39:52 user nova-compute[74080]: No targets found.
Oct 16 07:39:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:39:52 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:39:52 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5dd91-0411-40c6-a975-f55bcbc86783]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa0a9b-4e47-48d7-8521-b059d24bd3d4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:52 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:52 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:52 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:52 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:52 user nova-compute[74080]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:52 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac1ded40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b'): ({'sde'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Removing single pathed devices sde {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[95652717-a80f-4656-b756-828001edb996]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[943852a2-5e4b-4c42-b9df-487cbb0d2347]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flushing IO for device /dev/sde {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ced4b-aed4-4c22-8055-9c74656cf8a4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b871f8-fc60-4276-830d-b43e7457534c]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:39:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa80565d-7f33-439d-bff6-073eb4f58bba]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3590ab02-830f-40d6-ace9-e5cb84d3f9b7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]
Oct 16 07:39:53 user nova-compute[74080]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.
Oct 16 07:39:53 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f29c681-4853-4f2b-8743-384f45575a94]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== disconnect_volume: return (393ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Start _get_guest_xml network_info=[{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d057cc5a-de02-43b9-aa26-f17812bdf186,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'd057cc5a-de02-43b9-aa26-f17812bdf186'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '26f16d48-c8ab-4208-914b-08d6cc537cde', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsBeMvib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd2f1f6a7-9bf5-4542-8408-d634e25bbd66', 'attached_at': '', 'detached_at': '', 'volume_id': 'da228469-2aef-44ec-9590-4267470f6e1b', 'serial': 'da228469-2aef-44ec-9590-4267470f6e1b'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:39:53 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:53 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d057cc5a-de02-43b9-aa26-f17812bdf186,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.objects.instance [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.objects.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Object Instance<d2f1f6a7-9bf5-4542-8408-d634e25bbd66> lazy-loaded attributes: resources,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsBeMvib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:39:53 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:53 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:39:53 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f175bf-9f64-44c9-8aa9-7935911020ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:39:53 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a25360-6232-480c-8539-a5907302165d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b] added
Oct 16 07:39:53 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[561a43c6-7275-4e4c-a1b8-1cd714d6e5d0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51b8286-816c-4c5f-a139-628d5638061e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsBeMvib {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsBeMvib" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70181c2d-b988-418f-b3b9-cae8e70c397e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsBeMvib'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f725e18e-70be-4d5e-8d63-0ffa90322ec5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeebc78-1f64-475d-948c-7f5c86a5ccc5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d1a990-abdc-4400-a7f9-fa40fd003692]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]
Oct 16 07:39:53 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.
Oct 16 07:39:53 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534acce-58ea-4326-b1b7-53bfd80d74be]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a753f7fd-e19e-4640-b3f4-da4e14b9a9be]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:53 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:39:53 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:39:53 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d0124-ed37-4fce-b107-70e81a4b3b30]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:39:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsBeMvib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.compute.manager [req-e9f11d4a-ff2c-4cb1-af9c-c490ecbd8da5 req-4914d9e4-7efa-4d24-bb32-2b5643d496c3 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9f11d4a-ff2c-4cb1-af9c-c490ecbd8da5 req-4914d9e4-7efa-4d24-bb32-2b5643d496c3 service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9f11d4a-ff2c-4cb1-af9c-c490ecbd8da5 req-4914d9e4-7efa-4d24-bb32-2b5643d496c3 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e9f11d4a-ff2c-4cb1-af9c-c490ecbd8da5 req-4914d9e4-7efa-4d24-bb32-2b5643d496c3 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.compute.manager [req-e9f11d4a-ff2c-4cb1-af9c-c490ecbd8da5 req-4914d9e4-7efa-4d24-bb32-2b5643d496c3 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:54 user nova-compute[74080]: WARNING nova.compute.manager [req-e9f11d4a-ff2c-4cb1-af9c-c490ecbd8da5 req-4914d9e4-7efa-4d24-bb32-2b5643d496c3 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received unexpected event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 07:39:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26131663436393736', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131663436393736', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-293706194',display_name='tempest-TestMinimumBasicScenario-server-293706194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-293706194',id=21,image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HgaFzgT16PzViw2GUVBuCQPdZZAN2aJww3qG+wrjc0AB73ZDIFZ3GmBtwMglULbpdFjnprQLUiVvJqKWNNuIihlQ3mFyqoF9NZYtc5BfEv0ZlEub7B4odRbPJ/b/ocQ==',key_name='tempest-TestMinimumBasicScenario-871128063',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-bi7weth5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:39:52Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=d2f1f6a7-9bf5-4542-8408-d634e25bbd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.objects.instance [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'pci_devices' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.objects.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Object Instance<d2f1f6a7-9bf5-4542-8408-d634e25bbd66> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:39:54 user nova-compute[74080]:   <uuid>d2f1f6a7-9bf5-4542-8408-d634e25bbd66</uuid>
Oct 16 07:39:54 user nova-compute[74080]:   <name>instance-00000015</name>
Oct 16 07:39:54 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:39:54 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:39:54 user nova-compute[74080]:   <metadata>
Oct 16 07:39:54 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:39:54 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:39:54 user nova-compute[74080]:       <nova:name>tempest-TestMinimumBasicScenario-server-293706194</nova:name>
Oct 16 07:39:54 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:39:53</nova:creationTime>
Oct 16 07:39:54 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:39:54 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:39:54 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:39:54 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:39:54 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:39:54 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:39:54 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:39:54 user nova-compute[74080]:       <nova:owner>
Oct 16 07:39:54 user nova-compute[74080]:         <nova:user uuid="f95746283bb04c0c98d762068eaa5a24">tempest-TestMinimumBasicScenario-1785188875-project-member</nova:user>
Oct 16 07:39:54 user nova-compute[74080]:         <nova:project uuid="3c9d95219a244140a28a733edb91013b">tempest-TestMinimumBasicScenario-1785188875</nova:project>
Oct 16 07:39:54 user nova-compute[74080]:       </nova:owner>
Oct 16 07:39:54 user nova-compute[74080]:       <nova:root type="image" uuid="d057cc5a-de02-43b9-aa26-f17812bdf186"/>
Oct 16 07:39:54 user nova-compute[74080]:       <nova:ports>
Oct 16 07:39:54 user nova-compute[74080]:         <nova:port uuid="4255ae13-23f2-4c25-b194-9c4fc4ed9342">
Oct 16 07:39:54 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:39:54 user nova-compute[74080]:         </nova:port>
Oct 16 07:39:54 user nova-compute[74080]:       </nova:ports>
Oct 16 07:39:54 user nova-compute[74080]:     </nova:instance>
Oct 16 07:39:54 user nova-compute[74080]:   </metadata>
Oct 16 07:39:54 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:39:54 user nova-compute[74080]:     <system>
Oct 16 07:39:54 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:39:54 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:39:54 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:39:54 user nova-compute[74080]:       <entry name="serial">d2f1f6a7-9bf5-4542-8408-d634e25bbd66</entry>
Oct 16 07:39:54 user nova-compute[74080]:       <entry name="uuid">d2f1f6a7-9bf5-4542-8408-d634e25bbd66</entry>
Oct 16 07:39:54 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:39:54 user nova-compute[74080]:     </system>
Oct 16 07:39:54 user nova-compute[74080]:   </sysinfo>
Oct 16 07:39:54 user nova-compute[74080]:   <os>
Oct 16 07:39:54 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:39:54 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:39:54 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:39:54 user nova-compute[74080]:   </os>
Oct 16 07:39:54 user nova-compute[74080]:   <features>
Oct 16 07:39:54 user nova-compute[74080]:     <acpi/>
Oct 16 07:39:54 user nova-compute[74080]:     <apic/>
Oct 16 07:39:54 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:39:54 user nova-compute[74080]:   </features>
Oct 16 07:39:54 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:39:54 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:39:54 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:39:54 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:39:54 user nova-compute[74080]:   </clock>
Oct 16 07:39:54 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:39:54 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:39:54 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:39:54 user nova-compute[74080]:   </cpu>
Oct 16 07:39:54 user nova-compute[74080]:   <devices>
Oct 16 07:39:54 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:39:54 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:39:54 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk"/>
Oct 16 07:39:54 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:39:54 user nova-compute[74080]:     </disk>
Oct 16 07:39:54 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:39:54 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:39:54 user nova-compute[74080]:       <source dev="/dev/sdb"/>
Oct 16 07:39:54 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:39:54 user nova-compute[74080]:       <serial>da228469-2aef-44ec-9590-4267470f6e1b</serial>
Oct 16 07:39:54 user nova-compute[74080]:     </disk>
Oct 16 07:39:54 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:39:54 user nova-compute[74080]:       <mac address="fa:16:3e:71:ae:6a"/>
Oct 16 07:39:54 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:39:54 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:39:54 user nova-compute[74080]:       <target dev="tap4255ae13-23"/>
Oct 16 07:39:54 user nova-compute[74080]:     </interface>
Oct 16 07:39:54 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:39:54 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/console.log" append="off"/>
Oct 16 07:39:54 user nova-compute[74080]:     </serial>
Oct 16 07:39:54 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:39:54 user nova-compute[74080]:     <video>
Oct 16 07:39:54 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:39:54 user nova-compute[74080]:     </video>
Oct 16 07:39:54 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:39:54 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:39:54 user nova-compute[74080]:     </rng>
Oct 16 07:39:54 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:39:54 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:39:54 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:39:54 user nova-compute[74080]:     </memballoon>
Oct 16 07:39:54 user nova-compute[74080]:   </devices>
Oct 16 07:39:54 user nova-compute[74080]: </domain>
Oct 16 07:39:54 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.objects.instance [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'trusted_certs' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.objects.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Object Instance<d2f1f6a7-9bf5-4542-8408-d634e25bbd66> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4b85e69f3726a289f47aa53d121282832d7d244c --force-share --output=json" returned: 0 in 0.211s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Cannot resize image /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.objects.instance [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'migration_context' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.objects.base [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Object Instance<d2f1f6a7-9bf5-4542-8408-d634e25bbd66> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-293706194',display_name='tempest-TestMinimumBasicScenario-server-293706194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-293706194',id=21,image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HgaFzgT16PzViw2GUVBuCQPdZZAN2aJww3qG+wrjc0AB73ZDIFZ3GmBtwMglULbpdFjnprQLUiVvJqKWNNuIihlQ3mFyqoF9NZYtc5BfEv0ZlEub7B4odRbPJ/b/ocQ==',key_name='tempest-TestMinimumBasicScenario-871128063',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-bi7weth5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:39:52Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=d2f1f6a7-9bf5-4542-8408-d634e25bbd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG os_vif [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '937d8503-b8ad-534e-af6f-a0adda061b04', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4255ae13-23, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4255ae13-23, col_values=(('qos', UUID('a818cd45-4fed-4b12-b5cf-090b764c43ba')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4255ae13-23, col_values=(('external_ids', {'iface-id': '4255ae13-23f2-4c25-b194-9c4fc4ed9342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:ae:6a', 'vm-uuid': 'd2f1f6a7-9bf5-4542-8408-d634e25bbd66'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:39:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:55 user nova-compute[74080]: INFO os_vif [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23')
Oct 16 07:39:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-2d963ff7-320a-40cb-8ae0-9463a3ca54b2 req-77b9206b-9be8-41e0-93f7-97c58672cf9a service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2d963ff7-320a-40cb-8ae0-9463a3ca54b2 req-77b9206b-9be8-41e0-93f7-97c58672cf9a service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2d963ff7-320a-40cb-8ae0-9463a3ca54b2 req-77b9206b-9be8-41e0-93f7-97c58672cf9a service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2d963ff7-320a-40cb-8ae0-9463a3ca54b2 req-77b9206b-9be8-41e0-93f7-97c58672cf9a service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-2d963ff7-320a-40cb-8ae0-9463a3ca54b2 req-77b9206b-9be8-41e0-93f7-97c58672cf9a service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:57 user nova-compute[74080]: WARNING nova.compute.manager [req-2d963ff7-320a-40cb-8ae0-9463a3ca54b2 req-77b9206b-9be8-41e0-93f7-97c58672cf9a service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received unexpected event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 07:39:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:39:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-b327977a-0615-4ffa-816f-158bc97becd4 req-ecd73b1a-6d2f-4ec0-83ef-d363e635dffd service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:39:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b327977a-0615-4ffa-816f-158bc97becd4 req-ecd73b1a-6d2f-4ec0-83ef-d363e635dffd service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:39:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b327977a-0615-4ffa-816f-158bc97becd4 req-ecd73b1a-6d2f-4ec0-83ef-d363e635dffd service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:39:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b327977a-0615-4ffa-816f-158bc97becd4 req-ecd73b1a-6d2f-4ec0-83ef-d363e635dffd service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:39:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-b327977a-0615-4ffa-816f-158bc97becd4 req-ecd73b1a-6d2f-4ec0-83ef-d363e635dffd service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:39:59 user nova-compute[74080]: WARNING nova.compute.manager [req-b327977a-0615-4ffa-816f-158bc97becd4 req-ecd73b1a-6d2f-4ec0-83ef-d363e635dffd service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received unexpected event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 07:39:59 user nova-compute[74080]: DEBUG nova.compute.manager [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:39:59 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance rebooted successfully.
Oct 16 07:39:59 user nova-compute[74080]: DEBUG nova.compute.manager [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:39:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-640ff160-2c63-4649-813c-59c5fd15aaaf tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.726s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:00 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-changed-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Refreshing instance network info cache due to event network-changed-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:40:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] Acquiring lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] Acquired lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:01 user nova-compute[74080]: DEBUG nova.network.neutron [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Refreshing network info cache for port 1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updated VIF entry in instance network info cache for port 1dadda9b-6dc1-433f-85c4-df2e0d7dcc41. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updating instance_info_cache with network_info: [{"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cfad7930-cfa2-4d7d-baed-e95ffbe8dbbb req-796fab3d-97a2-428a-a630-198317e6eb76 service nova] Releasing lock "refresh_cache-e936b802-720b-4d2a-9930-5e7b5244b2c8" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:02 user nova-compute[74080]: INFO nova.compute.manager [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Terminating instance
Oct 16 07:40:02 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-6919bfc3-1c60-482e-a584-37fcf526e08f req-d5bb08c4-da52-48f7-bee0-faaa1d96959e service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-unplugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6919bfc3-1c60-482e-a584-37fcf526e08f req-d5bb08c4-da52-48f7-bee0-faaa1d96959e service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6919bfc3-1c60-482e-a584-37fcf526e08f req-d5bb08c4-da52-48f7-bee0-faaa1d96959e service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6919bfc3-1c60-482e-a584-37fcf526e08f req-d5bb08c4-da52-48f7-bee0-faaa1d96959e service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-6919bfc3-1c60-482e-a584-37fcf526e08f req-d5bb08c4-da52-48f7-bee0-faaa1d96959e service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-unplugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-6919bfc3-1c60-482e-a584-37fcf526e08f req-d5bb08c4-da52-48f7-bee0-faaa1d96959e service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-unplugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Instance destroyed successfully.
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.objects.instance [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'resources' on Instance uuid e936b802-720b-4d2a-9930-5e7b5244b2c8 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1156738755',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1156738755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1156738755',id=24,image_ref='e1417b0e-b7e1-447f-9055-34f87f9be27e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtPDeELZsk4WwhURf6zsafnyE64My/JD/vJjjqNWHrRF8wgkHuP2CoAYw+uD57DwZYDZ4yQsZnldn+XPaHjpJYc2nU+sDaTsb+Ylr4OEtPyfQf24psc9B4TB25IOWH0ew==',key_name='tempest-keypair-1541947393',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:38:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-g7r9ybxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-959199453',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:38:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33b58ae309d047548ebf29684db6037e',uuid=e936b802-720b-4d2a-9930-5e7b5244b2c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "address": "fa:16:3e:a0:ce:d2", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dadda9b-6d", "ovs_interfaceid": "1dadda9b-6dc1-433f-85c4-df2e0d7dcc41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ce:d2,bridge_name='br-int',has_traffic_filtering=True,id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dadda9b-6d') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_vif [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ce:d2,bridge_name='br-int',has_traffic_filtering=True,id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dadda9b-6d') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dadda9b-6d, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8f22f93-d395-43ab-9483-f401697a7bb6) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: INFO os_vif [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:ce:d2,bridge_name='br-int',has_traffic_filtering=True,id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dadda9b-6d')
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PxRfVdoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:40:03 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff8700c-8d42-4fef-a2de-26271439263c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:40:03 user nova-compute[74080]: No targets found.
Oct 16 07:40:03 user nova-compute[74080]: iSNS:
Oct 16 07:40:03 user nova-compute[74080]: No targets found.
Oct 16 07:40:03 user nova-compute[74080]: STATIC:
Oct 16 07:40:03 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:40:03 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:03 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:03 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc
Oct 16 07:40:03 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:03 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:03 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:40:03 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:03 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:03 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:40:03 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:03 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:03 user nova-compute[74080]: FIRMWARE:
Oct 16 07:40:03 user nova-compute[74080]: No targets found.
Oct 16 07:40:03 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:40:03 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:40:03 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45457f19-3185-416e-8458-01495b392b22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa717e34-5c80-4e89-91f2-4f7869fb01c5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:03 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:40:03 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:03 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:03 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:03 user nova-compute[74080]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc (non-flash)
Oct 16 07:40:03 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:03 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:03 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac3ba050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc'): ({'sdd'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Removing single pathed devices sdd {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc34e27-1f20-483e-9267-53ca158c2a28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00233f1-b731-4e86-98a8-d381c9119cc5]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flushing IO for device /dev/sdd {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f17dd9-a498-462a-8f2d-2b77b845aa92]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.072s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b4b358-e31b-4506-91ee-7ebe4a4ee905]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_43acecbf', '/dev/disk/by-id/scsi-23131396330323739', '/dev/disk/by-id/scsi-1SCST_BIO43acecbf-119c027997429a54') {{(pid=85089) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe6a3f-73ee-4815-accf-66ae91a99c1e]: (4, None) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec682f2-268d-471f-bbc0-5e1eac43da4e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --logout" returned: 0 in 0.126s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[272fde76-cb28-4141-a5a9-5f91fd9dbdef]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260]
Oct 16 07:40:03 user nova-compute[74080]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc, portal: 172.16.0.220,3260] successful.
Oct 16 07:40:03 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf8fd1d-790f-4188-909c-e834e45a0ffc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0abaeb-23c7-48b0-87e6-b857571726df]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== disconnect_volume: return (482ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:40:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:40:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Deleting instance files /opt/stack/data/nova/instances/e936b802-720b-4d2a-9930-5e7b5244b2c8_del
Oct 16 07:40:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Deletion of /opt/stack/data/nova/instances/e936b802-720b-4d2a-9930-5e7b5244b2c8_del complete
Oct 16 07:40:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:04 user nova-compute[74080]: INFO nova.compute.manager [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Took 1.52 seconds to destroy the instance on the hypervisor.
Oct 16 07:40:04 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:40:04 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:40:04 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:40:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-0af56f03-b29d-4ef2-b2eb-4399aab2e53c req-8f99bf9b-3af1-4687-949a-39067b7e573d service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-deleted-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:05 user nova-compute[74080]: INFO nova.compute.manager [req-0af56f03-b29d-4ef2-b2eb-4399aab2e53c req-8f99bf9b-3af1-4687-949a-39067b7e573d service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Neutron deleted interface 1dadda9b-6dc1-433f-85c4-df2e0d7dcc41; detaching it from the instance and deleting it from the info cache
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.network.neutron [req-0af56f03-b29d-4ef2-b2eb-4399aab2e53c req-8f99bf9b-3af1-4687-949a-39067b7e573d service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:05 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Took 1.01 seconds to deallocate network for instance.
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-0af56f03-b29d-4ef2-b2eb-4399aab2e53c req-8f99bf9b-3af1-4687-949a-39067b7e573d service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Detach interface failed, port_id=1dadda9b-6dc1-433f-85c4-df2e0d7dcc41, reason: Instance e936b802-720b-4d2a-9930-5e7b5244b2c8 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:05 user nova-compute[74080]: WARNING nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received unexpected event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with vm_state active and task_state deleting.
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:05 user nova-compute[74080]: WARNING nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received unexpected event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with vm_state active and task_state deleting.
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:05 user nova-compute[74080]: WARNING nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received unexpected event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with vm_state active and task_state deleting.
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-unplugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-unplugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-unplugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Acquiring lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] No waiting events found dispatching network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:05 user nova-compute[74080]: WARNING nova.compute.manager [req-f3afac6d-0fca-4822-93ff-3059bfd722d0 req-12a912d4-9c17-4e3b-9758-e61457dc3458 service nova] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Received unexpected event network-vif-plugged-1dadda9b-6dc1-433f-85c4-df2e0d7dcc41 for instance with vm_state active and task_state deleting.
Oct 16 07:40:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:40:08 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:40:08 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:40:08 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b79558-2595-4c6c-a429-85558139008e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:40:08 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2578224c-2f5f-4aa0-b66f-a3ab174b1094]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d] added
Oct 16 07:40:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94aec81-e85b-40ce-b624-cfdd354784a8]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c3d4d-3990-42de-9083-2b335ca9dd7e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeaYpBEt {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeaYpBEt" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cb93e3-26a4-490d-bf9b-9bec2756d09d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IeaYpBEt'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54ac2fe-1399-424d-a346-422e9ca484e6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[49be8755-374e-429d-9ce7-42e44444fbfb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:08 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:08 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:08 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:08 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:09 user nova-compute[74080]: INFO nova.compute.manager [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Took 4.08 seconds to detach 1 volumes for instance.
Oct 16 07:40:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e936b802-720b-4d2a-9930-5e7b5244b2c8] Deleting volume: fcf8fd1d-790f-4188-909c-e834e45a0ffc {{(pid=74080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --login" returned: 0 in 1.081s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb332d2-8e94-4091-94b5-cbfb6c2ff7d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]
Oct 16 07:40:09 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.
Oct 16 07:40:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9962fc6-550d-4fc8-897b-72a29ce57f6a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abe71a3-fca2-4109-8b8b-a1bcca7957de]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:09 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:09 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:09 user nova-compute[74080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:40:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:09 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:09 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:09 user nova-compute[74080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:40:09 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.327s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b13551-11ec-4d5f-895c-4804599fe09b]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:09 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Deleted allocations for instance e936b802-720b-4d2a-9930-5e7b5244b2c8
Oct 16 07:40:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5c7a95de-89b2-45d1-a9ba-724c5a3ac550 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e936b802-720b-4d2a-9930-5e7b5244b2c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.428s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:10 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:40:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:40:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.359s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:40:10 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== connect_volume: return (2361ms) {'type': 'block', 'scsi_wwn': '26661376161313731', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:40:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661376161313731', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:40:10 user nova-compute[74080]: DEBUG nova.objects.instance [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'flavor' on Instance uuid d78e592d-691e-4fa1-9840-8f436fa17f0d {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:40:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:40:10 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:40:10 user nova-compute[74080]:   <source dev="/dev/sdd"/>
Oct 16 07:40:10 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:40:10 user nova-compute[74080]:   <serial>6c3a1050-fb68-46fe-b2e0-d6d6eb03938d</serial>
Oct 16 07:40:10 user nova-compute[74080]: </disk>
Oct 16 07:40:10 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:40:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:40:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:40:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No VIF found with MAC fa:16:3e:cb:9a:c4, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:40:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-138e4564-ab18-4b4b-9038-ba9e52f5618a tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.067s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:40:12 user nova-compute[74080]: INFO nova.compute.claims [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Claim successful on node user
Oct 16 07:40:12 user nova-compute[74080]: INFO nova.compute.manager [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Rebuilding instance
Oct 16 07:40:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Refreshing inventories for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Updating ProviderTree inventory for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Updating inventory in ProviderTree for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 07:40:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Refreshing aggregate associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, aggregates: None {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Refreshing trait associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-b34ab828-af65-4574-933f-51533ad53f9d req-c9d74a2a-b4ff-4d8b-a7bf-2dd851247407 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-unplugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b34ab828-af65-4574-933f-51533ad53f9d req-c9d74a2a-b4ff-4d8b-a7bf-2dd851247407 service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b34ab828-af65-4574-933f-51533ad53f9d req-c9d74a2a-b4ff-4d8b-a7bf-2dd851247407 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b34ab828-af65-4574-933f-51533ad53f9d req-c9d74a2a-b4ff-4d8b-a7bf-2dd851247407 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-b34ab828-af65-4574-933f-51533ad53f9d req-c9d74a2a-b4ff-4d8b-a7bf-2dd851247407 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-unplugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:13 user nova-compute[74080]: WARNING nova.compute.manager [req-b34ab828-af65-4574-933f-51533ad53f9d req-c9d74a2a-b4ff-4d8b-a7bf-2dd851247407 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received unexpected event network-vif-unplugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with vm_state active and task_state rebuilding.
Oct 16 07:40:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.781s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:40:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.policy [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a7347ee6d924888a4ba0eae614a2798', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73dfaec529db4de28029e7186f4dc99f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:40:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance destroyed successfully.
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:40:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Creating image(s)
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:13 user nova-compute[74080]: INFO nova.compute.manager [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Detaching volume 6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:40:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: INFO nova.virt.block_device [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Attempting to driver detach volume 6c3a1050-fb68-46fe-b2e0-d6d6eb03938d from mountpoint /dev/vdb
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Attempting to detach device vdb from instance d78e592d-691e-4fa1-9840-8f436fa17f0d from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:40:14 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:40:14 user nova-compute[74080]:   <source dev="/dev/sdd"/>
Oct 16 07:40:14 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:40:14 user nova-compute[74080]:   <serial>6c3a1050-fb68-46fe-b2e0-d6d6eb03938d</serial>
Oct 16 07:40:14 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:40:14 user nova-compute[74080]: </disk>
Oct 16 07:40:14 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:40:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully detached device vdb from instance d78e592d-691e-4fa1-9840-8f436fa17f0d from the persistent domain config.
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:40:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[14598e10-76e6-4d16-812e-0a41e0816887]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:40:14 user nova-compute[74080]: No targets found.
Oct 16 07:40:14 user nova-compute[74080]: iSNS:
Oct 16 07:40:14 user nova-compute[74080]: No targets found.
Oct 16 07:40:14 user nova-compute[74080]: STATIC:
Oct 16 07:40:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:40:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:40:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:40:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:40:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:14 user nova-compute[74080]: FIRMWARE:
Oct 16 07:40:14 user nova-compute[74080]: No targets found.
Oct 16 07:40:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:40:14 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:40:14 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8356dbfc-c042-46ac-afae-b35abbff5d51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[187f6620-af2b-43f2-9feb-29b21bc1baf8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:14 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:14 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:14 user nova-compute[74080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:40:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:14 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:14 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:14 user nova-compute[74080]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:40:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7c43bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d'): ({'sdd'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Removing single pathed devices sdd {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.208s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0a387-e16b-4dd2-af02-7fa2a8009918]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk 1073741824" returned: 0 in 0.060s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd0f564-10bf-477b-88e2-54e34cc2f825]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flushing IO for device /dev/sdd {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6a4d66-ec6e-4545-bd31-3a368e749d4d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f37c928-786e-4878-a10b-ddbf29b77605]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3a4fab-dc96-4b28-940c-1e5fc4713723]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.network.neutron [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Successfully created port: d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.212s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2545b4-e4f0-45d2-875c-8b01d41c7d3b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]
Oct 16 07:40:14 user nova-compute[74080]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.
Oct 16 07:40:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d207070b-9c1e-4f1e-be4f-873721123f49]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== disconnect_volume: return (441ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Cannot resize image /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Ensure instance console log exists: /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.neutron [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Successfully updated port: d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquired lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.neutron [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.neutron [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.neutron [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Releasing lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance network_info: |[{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Start _get_guest_xml network_info=[{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:40:15 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:40:15 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-249230266',display_name='tempest-ServerStableDeviceRescueTest-server-249230266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-249230266',id=29,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnrYUgnNVaIXWMKCVNKUFovEiNpR42onkWyuP6mKDHHvFakfyOXGpH8jYZWabe2WfukXV1HmPadf31ItRgy/Ki2t1dXenFXypK+V2OhzZvGEAzuJYEOiEqtCecaqZQXrQ==',key_name='tempest-keypair-687037286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73dfaec529db4de28029e7186f4dc99f',ramdisk_id='',reservation_id='r-lkd9yen0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1785898129',owner_user_name='tempest-ServerStableDeviceRescueTest-1785898129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a7347ee6d924888a4ba0eae614a2798',uuid=b50a04d5-3359-4be0-879a-0fc018b0ed3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converting VIF {"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.objects.instance [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'pci_devices' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:15 user nova-compute[74080]: WARNING nova.compute.manager [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received unexpected event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with vm_state active and task_state rebuilding.
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing instance network info cache due to event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] Acquiring lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] Acquired lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.neutron [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:40:15 user nova-compute[74080]:   <uuid>b50a04d5-3359-4be0-879a-0fc018b0ed3e</uuid>
Oct 16 07:40:15 user nova-compute[74080]:   <name>instance-0000001d</name>
Oct 16 07:40:15 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:40:15 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:40:15 user nova-compute[74080]:   <metadata>
Oct 16 07:40:15 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:40:15 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:40:15 user nova-compute[74080]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-249230266</nova:name>
Oct 16 07:40:15 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:40:15</nova:creationTime>
Oct 16 07:40:15 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:40:15 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:40:15 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:40:15 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:40:15 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:40:15 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:40:15 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:40:15 user nova-compute[74080]:       <nova:owner>
Oct 16 07:40:15 user nova-compute[74080]:         <nova:user uuid="4a7347ee6d924888a4ba0eae614a2798">tempest-ServerStableDeviceRescueTest-1785898129-project-member</nova:user>
Oct 16 07:40:15 user nova-compute[74080]:         <nova:project uuid="73dfaec529db4de28029e7186f4dc99f">tempest-ServerStableDeviceRescueTest-1785898129</nova:project>
Oct 16 07:40:15 user nova-compute[74080]:       </nova:owner>
Oct 16 07:40:15 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:40:15 user nova-compute[74080]:       <nova:ports>
Oct 16 07:40:15 user nova-compute[74080]:         <nova:port uuid="d5f6c16f-cc65-486c-a75e-06889c7b1d9f">
Oct 16 07:40:15 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 07:40:15 user nova-compute[74080]:         </nova:port>
Oct 16 07:40:15 user nova-compute[74080]:       </nova:ports>
Oct 16 07:40:15 user nova-compute[74080]:     </nova:instance>
Oct 16 07:40:15 user nova-compute[74080]:   </metadata>
Oct 16 07:40:15 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:40:15 user nova-compute[74080]:     <system>
Oct 16 07:40:15 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:40:15 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:40:15 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:40:15 user nova-compute[74080]:       <entry name="serial">b50a04d5-3359-4be0-879a-0fc018b0ed3e</entry>
Oct 16 07:40:15 user nova-compute[74080]:       <entry name="uuid">b50a04d5-3359-4be0-879a-0fc018b0ed3e</entry>
Oct 16 07:40:15 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:40:15 user nova-compute[74080]:     </system>
Oct 16 07:40:15 user nova-compute[74080]:   </sysinfo>
Oct 16 07:40:15 user nova-compute[74080]:   <os>
Oct 16 07:40:15 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:40:15 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:40:15 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:40:15 user nova-compute[74080]:   </os>
Oct 16 07:40:15 user nova-compute[74080]:   <features>
Oct 16 07:40:15 user nova-compute[74080]:     <acpi/>
Oct 16 07:40:15 user nova-compute[74080]:     <apic/>
Oct 16 07:40:15 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:40:15 user nova-compute[74080]:   </features>
Oct 16 07:40:15 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:40:15 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:40:15 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:40:15 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:40:15 user nova-compute[74080]:   </clock>
Oct 16 07:40:15 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:40:15 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:40:15 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:40:15 user nova-compute[74080]:   </cpu>
Oct 16 07:40:15 user nova-compute[74080]:   <devices>
Oct 16 07:40:15 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:40:15 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:40:15 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk"/>
Oct 16 07:40:15 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:40:15 user nova-compute[74080]:     </disk>
Oct 16 07:40:15 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:40:15 user nova-compute[74080]:       <mac address="fa:16:3e:f1:12:22"/>
Oct 16 07:40:15 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:40:15 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:40:15 user nova-compute[74080]:       <target dev="tapd5f6c16f-cc"/>
Oct 16 07:40:15 user nova-compute[74080]:     </interface>
Oct 16 07:40:15 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:40:15 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/console.log" append="off"/>
Oct 16 07:40:15 user nova-compute[74080]:     </serial>
Oct 16 07:40:15 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:40:15 user nova-compute[74080]:     <video>
Oct 16 07:40:15 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:40:15 user nova-compute[74080]:     </video>
Oct 16 07:40:15 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:40:15 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:40:15 user nova-compute[74080]:     </rng>
Oct 16 07:40:15 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:40:15 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:40:15 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:40:15 user nova-compute[74080]:     </memballoon>
Oct 16 07:40:15 user nova-compute[74080]:   </devices>
Oct 16 07:40:15 user nova-compute[74080]: </domain>
Oct 16 07:40:15 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-249230266',display_name='tempest-ServerStableDeviceRescueTest-server-249230266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-249230266',id=29,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnrYUgnNVaIXWMKCVNKUFovEiNpR42onkWyuP6mKDHHvFakfyOXGpH8jYZWabe2WfukXV1HmPadf31ItRgy/Ki2t1dXenFXypK+V2OhzZvGEAzuJYEOiEqtCecaqZQXrQ==',key_name='tempest-keypair-687037286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73dfaec529db4de28029e7186f4dc99f',ramdisk_id='',reservation_id='r-lkd9yen0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1785898129',owner_user_name='tempest-ServerStableDeviceRescueTest-1785898129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:40:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a7347ee6d924888a4ba0eae614a2798',uuid=b50a04d5-3359-4be0-879a-0fc018b0ed3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converting VIF {"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG os_vif [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4e9a2bb-69f2-546d-b98e-f790e65a577a', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5f6c16f-cc, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd5f6c16f-cc, col_values=(('qos', UUID('d2a118e7-c719-421e-900e-328ab4d981f8')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd5f6c16f-cc, col_values=(('external_ids', {'iface-id': 'd5f6c16f-cc65-486c-a75e-06889c7b1d9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:12:22', 'vm-uuid': 'b50a04d5-3359-4be0-879a-0fc018b0ed3e'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:15 user nova-compute[74080]: INFO os_vif [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc')
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:40:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No VIF found with MAC fa:16:3e:f1:12:22, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:40:16 user nova-compute[74080]: DEBUG nova.network.neutron [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updated VIF entry in instance network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:40:16 user nova-compute[74080]: DEBUG nova.network.neutron [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e8cff48-4695-4a21-a8cd-933e6038c959 req-5d264e30-7982-41fe-9bb7-0dc9868b6145 service nova] Releasing lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:16 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-703fadfa-91fd-446a-b5fa-3d55c54b295f req-55c0ba10-2f33-4b72-a34e-37a9f7d439e6 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-703fadfa-91fd-446a-b5fa-3d55c54b295f req-55c0ba10-2f33-4b72-a34e-37a9f7d439e6 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-703fadfa-91fd-446a-b5fa-3d55c54b295f req-55c0ba10-2f33-4b72-a34e-37a9f7d439e6 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-703fadfa-91fd-446a-b5fa-3d55c54b295f req-55c0ba10-2f33-4b72-a34e-37a9f7d439e6 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-703fadfa-91fd-446a-b5fa-3d55c54b295f req-55c0ba10-2f33-4b72-a34e-37a9f7d439e6 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:17 user nova-compute[74080]: WARNING nova.compute.manager [req-703fadfa-91fd-446a-b5fa-3d55c54b295f req-55c0ba10-2f33-4b72-a34e-37a9f7d439e6 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state building and task_state spawning.
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:18 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updating instance_info_cache with network_info: [{"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:40:19 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance spawned successfully.
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:19 user nova-compute[74080]: INFO nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:40:19 user nova-compute[74080]: INFO nova.compute.manager [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Took 7.06 seconds to build instance.
Oct 16 07:40:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-08e5d32a-d937-463c-be82-e68f1cf9ce4d tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.182s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c5613eb-b39e-45c3-a20d-50df9eb0fb03 req-b2573b46-acea-4df7-a26b-0ca51cc08767 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c5613eb-b39e-45c3-a20d-50df9eb0fb03 req-b2573b46-acea-4df7-a26b-0ca51cc08767 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c5613eb-b39e-45c3-a20d-50df9eb0fb03 req-b2573b46-acea-4df7-a26b-0ca51cc08767 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c5613eb-b39e-45c3-a20d-50df9eb0fb03 req-b2573b46-acea-4df7-a26b-0ca51cc08767 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:19 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c5613eb-b39e-45c3-a20d-50df9eb0fb03 req-b2573b46-acea-4df7-a26b-0ca51cc08767 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:19 user nova-compute[74080]: WARNING nova.compute.manager [req-3c5613eb-b39e-45c3-a20d-50df9eb0fb03 req-b2573b46-acea-4df7-a26b-0ca51cc08767 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state active and task_state None.
Oct 16 07:40:20 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:40:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:23 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance destroyed successfully.
Oct 16 07:40:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-42157221',display_name='tempest-ServerActionsTestOtherA-server-2101783169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-42157221',id=25,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs9QYYmApPo/IdFZYUpvJuopfWBor9lAxprFyaOW8mIlMKQXXtBqQiy+txKogOD/oYyzWsOFmEbKYoQGKozjO5zcNKMNfcxjhdCxwKZf85uWPefm0SbTBKdqNOzO4jZ/g==',key_name='tempest-keypair-676640173',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-dta6ryi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=d78e592d-691e-4fa1-9840-8f436fa17f0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG os_vif [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c3048c-e1, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1226a45-b1d4-4659-b6df-853c77429a05) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:23 user nova-compute[74080]: INFO os_vif [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1')
Oct 16 07:40:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:40:23 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:40:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ba731d-59a6-4631-84ce-1b4c8ee79287]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:40:23 user nova-compute[74080]: No targets found.
Oct 16 07:40:23 user nova-compute[74080]: iSNS:
Oct 16 07:40:23 user nova-compute[74080]: No targets found.
Oct 16 07:40:23 user nova-compute[74080]: STATIC:
Oct 16 07:40:23 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:40:23 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:23 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:23 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:40:23 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:23 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:23 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:40:23 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:40:23 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:40:23 user nova-compute[74080]: FIRMWARE:
Oct 16 07:40:23 user nova-compute[74080]: No targets found.
Oct 16 07:40:23 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:40:23 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:40:23 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[559edebe-281d-43e1-aa06-fb38abefbe9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d9f776-919a-4471-8ff5-40f6699a529e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:24 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:24 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:40:24 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:40:24 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:40:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac259a20>, {}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Disconnecting from: [] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== disconnect_volume: return (82ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:40:24 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Deleting instance files /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d_del
Oct 16 07:40:24 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Deletion of /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d_del complete
Oct 16 07:40:24 user nova-compute[74080]: INFO nova.virt.block_device [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Booting with volume 6c3a1050-fb68-46fe-b2e0-d6d6eb03938d at /dev/vdb
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.utils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f9e3d-bd29-4870-bc13-366c1cb6f423]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3544e3-fe6b-42c6-ac95-292f8de84598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a840942-7cfb-4448-afef-84e7e21d6df9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4d15dd-36c6-47ea-91bb-644f7b7ff9c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:40:24 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25681f-a467-4bf5-875d-eda221ad7557]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG os_brick.utils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updating existing volume attachment record: 672bf6a3-5832-4927-b83a-7f236f29568c {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing instance network info cache due to event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] Acquiring lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] Acquired lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG nova.network.neutron [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updated VIF entry in instance network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG nova.network.neutron [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eca83ae8-e60e-4c16-90e0-f08e5469281b req-46ecfa06-1061-482a-9b25-d31e1a59ed2c service nova] Releasing lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:29 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:40:29 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7626MB free_disk=25.28408432006836GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d78e592d-691e-4fa1-9840-8f436fa17f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:40:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:33 user nova-compute[74080]: INFO nova.compute.manager [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Shelving
Oct 16 07:40:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-ecdf9a48-9b60-4ef1-aa27-7bd3105230c8 req-96545e77-4e7e-4158-9ff6-46fe00e4b922 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-unplugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ecdf9a48-9b60-4ef1-aa27-7bd3105230c8 req-96545e77-4e7e-4158-9ff6-46fe00e4b922 service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ecdf9a48-9b60-4ef1-aa27-7bd3105230c8 req-96545e77-4e7e-4158-9ff6-46fe00e4b922 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ecdf9a48-9b60-4ef1-aa27-7bd3105230c8 req-96545e77-4e7e-4158-9ff6-46fe00e4b922 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-ecdf9a48-9b60-4ef1-aa27-7bd3105230c8 req-96545e77-4e7e-4158-9ff6-46fe00e4b922 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-unplugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:34 user nova-compute[74080]: WARNING nova.compute.manager [req-ecdf9a48-9b60-4ef1-aa27-7bd3105230c8 req-96545e77-4e7e-4158-9ff6-46fe00e4b922 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received unexpected event network-vif-unplugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with vm_state active and task_state shelving.
Oct 16 07:40:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance destroyed successfully.
Oct 16 07:40:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Beginning cold snapshot process
Oct 16 07:40:34 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:40:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk /opt/stack/data/nova/instances/snapshots/tmp_f_ycmn7/99226bea1d6a4513a95e22104f4eac1e {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk /opt/stack/data/nova/instances/snapshots/tmp_f_ycmn7/99226bea1d6a4513a95e22104f4eac1e" returned: 0 in 0.873s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Snapshot extracted, beginning image upload
Oct 16 07:40:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-0c85766b-0fe9-4b63-bf8a-f683740e9572 req-9acbfb95-b8f7-4880-87ae-346946f38f0f service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0c85766b-0fe9-4b63-bf8a-f683740e9572 req-9acbfb95-b8f7-4880-87ae-346946f38f0f service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0c85766b-0fe9-4b63-bf8a-f683740e9572 req-9acbfb95-b8f7-4880-87ae-346946f38f0f service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0c85766b-0fe9-4b63-bf8a-f683740e9572 req-9acbfb95-b8f7-4880-87ae-346946f38f0f service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-0c85766b-0fe9-4b63-bf8a-f683740e9572 req-9acbfb95-b8f7-4880-87ae-346946f38f0f service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:36 user nova-compute[74080]: WARNING nova.compute.manager [req-0c85766b-0fe9-4b63-bf8a-f683740e9572 req-9acbfb95-b8f7-4880-87ae-346946f38f0f service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received unexpected event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 07:40:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Snapshot image upload complete
Oct 16 07:40:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:40:39 user nova-compute[74080]: INFO nova.compute.manager [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Shelve offloading
Oct 16 07:40:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance destroyed successfully.
Oct 16 07:40:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:40:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquired lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:40:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Releasing lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance destroyed successfully.
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.objects.instance [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'resources' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1117384875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1117384875',id=27,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeOc6LSMg448zm8oKp/CpvM45DyfJHK3JogQFSdvOw52HcyFNVd6oqizTCDKiNffHJwyyEUp8xQTjfbCIeH4Pmt/3ZETdBYDJNEqoJ1MFg8dUL7Ck+E0j406SgVFQNCVg==',key_name='tempest-keypair-1371470985',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:38:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-nvxk32j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member',shelved_at='2023-10-16T07:40:39.030227',shelved_host='user',shelved_image_id='3f4752ca-633a-4f2e-a292-b035d964b8ba'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=d3e5e8b9-5b6f-446a-aabe-2944817a3756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG os_vif [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab1e9e8-5b, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff5331cf-0a83-4bdf-ad9d-1cc0f1886c72) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing instance network info cache due to event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] Acquiring lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] Acquired lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:40 user nova-compute[74080]: INFO os_vif [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b')
Oct 16 07:40:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Deleting instance files /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756_del
Oct 16 07:40:40 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Deletion of /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756_del complete
Oct 16 07:40:40 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Deleted allocations for instance d3e5e8b9-5b6f-446a-aabe-2944817a3756
Oct 16 07:40:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.objects.instance [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'numa_topology' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.objects.base [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Object Instance<d3e5e8b9-5b6f-446a-aabe-2944817a3756> lazy-loaded attributes: resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updated VIF entry in instance network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.network.neutron [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b2c737bc-bb3f-414e-a20b-a614f1d0a003 req-2c71255a-911a-4954-a081-c7fa40b2be19 service nova] Releasing lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:40:40 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:40:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c70b2d39-eb5d-449b-85a8-7ebde66c0dbf tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.355s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:40:47 user nova-compute[74080]: INFO nova.compute.claims [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Claim successful on node user
Oct 16 07:40:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:40:47 user nova-compute[74080]: DEBUG nova.network.neutron [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:40:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.policy [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69562ed193c74ec0815d41cbe9b662c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbb580495c34728bb3d06e92842737d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:40:48 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Creating image(s)
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "/opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "/opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.166s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk 1073741824" returned: 0 in 0.048s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.165s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Successfully created port: 38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Cannot resize image /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Ensure instance console log exists: /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Successfully updated port: 38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquired lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-changed-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Refreshing instance network info cache due to event network-changed-38df3710-5b78-4ec5-963b-42f349b9c387. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] Acquiring lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Updating instance_info_cache with network_info: [{"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Releasing lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Instance network_info: |[{"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] Acquired lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Refreshing network info cache for port 38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Start _get_guest_xml network_info=[{"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:40:49 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:40:49 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1492485079',display_name='tempest-VolumesSnapshotTestJSON-instance-1492485079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1492485079',id=30,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxZSP2FWXmFm13pKrU2RlH3TeRY0wSePQm2TY3KlnJfnz9RtV8lLLkRZXG+g3+EAgvixXC3z9kAEjYTiu5o+4eFT65HrmvE/gu25IraPa+/dZIzDvHSWgwUy+AQBSruLw==',key_name='tempest-keypair-587015676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dbb580495c34728bb3d06e92842737d',ramdisk_id='',reservation_id='r-60qt8c7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389413629',owner_user_name='tempest-VolumesSnapshotTestJSON-389413629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69562ed193c74ec0815d41cbe9b662c1',uuid=ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converting VIF {"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:64:ae,bridge_name='br-int',has_traffic_filtering=True,id=38df3710-5b78-4ec5-963b-42f349b9c387,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38df3710-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.objects.instance [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'pci_devices' on Instance uuid ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:40:49 user nova-compute[74080]:   <uuid>ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9</uuid>
Oct 16 07:40:49 user nova-compute[74080]:   <name>instance-0000001e</name>
Oct 16 07:40:49 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:40:49 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:40:49 user nova-compute[74080]:   <metadata>
Oct 16 07:40:49 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:40:49 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:40:49 user nova-compute[74080]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1492485079</nova:name>
Oct 16 07:40:49 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:40:49</nova:creationTime>
Oct 16 07:40:49 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:40:49 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:40:49 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:40:49 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:40:49 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:40:49 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:40:49 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:40:49 user nova-compute[74080]:       <nova:owner>
Oct 16 07:40:49 user nova-compute[74080]:         <nova:user uuid="69562ed193c74ec0815d41cbe9b662c1">tempest-VolumesSnapshotTestJSON-389413629-project-member</nova:user>
Oct 16 07:40:49 user nova-compute[74080]:         <nova:project uuid="7dbb580495c34728bb3d06e92842737d">tempest-VolumesSnapshotTestJSON-389413629</nova:project>
Oct 16 07:40:49 user nova-compute[74080]:       </nova:owner>
Oct 16 07:40:49 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:40:49 user nova-compute[74080]:       <nova:ports>
Oct 16 07:40:49 user nova-compute[74080]:         <nova:port uuid="38df3710-5b78-4ec5-963b-42f349b9c387">
Oct 16 07:40:49 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 07:40:49 user nova-compute[74080]:         </nova:port>
Oct 16 07:40:49 user nova-compute[74080]:       </nova:ports>
Oct 16 07:40:49 user nova-compute[74080]:     </nova:instance>
Oct 16 07:40:49 user nova-compute[74080]:   </metadata>
Oct 16 07:40:49 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:40:49 user nova-compute[74080]:     <system>
Oct 16 07:40:49 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:40:49 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:40:49 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:40:49 user nova-compute[74080]:       <entry name="serial">ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9</entry>
Oct 16 07:40:49 user nova-compute[74080]:       <entry name="uuid">ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9</entry>
Oct 16 07:40:49 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:40:49 user nova-compute[74080]:     </system>
Oct 16 07:40:49 user nova-compute[74080]:   </sysinfo>
Oct 16 07:40:49 user nova-compute[74080]:   <os>
Oct 16 07:40:49 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:40:49 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:40:49 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:40:49 user nova-compute[74080]:   </os>
Oct 16 07:40:49 user nova-compute[74080]:   <features>
Oct 16 07:40:49 user nova-compute[74080]:     <acpi/>
Oct 16 07:40:49 user nova-compute[74080]:     <apic/>
Oct 16 07:40:49 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:40:49 user nova-compute[74080]:   </features>
Oct 16 07:40:49 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:40:49 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:40:49 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:40:49 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:40:49 user nova-compute[74080]:   </clock>
Oct 16 07:40:49 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:40:49 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:40:49 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:40:49 user nova-compute[74080]:   </cpu>
Oct 16 07:40:49 user nova-compute[74080]:   <devices>
Oct 16 07:40:49 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:40:49 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:40:49 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk"/>
Oct 16 07:40:49 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:40:49 user nova-compute[74080]:     </disk>
Oct 16 07:40:49 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:40:49 user nova-compute[74080]:       <mac address="fa:16:3e:38:64:ae"/>
Oct 16 07:40:49 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:40:49 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:40:49 user nova-compute[74080]:       <target dev="tap38df3710-5b"/>
Oct 16 07:40:49 user nova-compute[74080]:     </interface>
Oct 16 07:40:49 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:40:49 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/console.log" append="off"/>
Oct 16 07:40:49 user nova-compute[74080]:     </serial>
Oct 16 07:40:49 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:40:49 user nova-compute[74080]:     <video>
Oct 16 07:40:49 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:40:49 user nova-compute[74080]:     </video>
Oct 16 07:40:49 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:40:49 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:40:49 user nova-compute[74080]:     </rng>
Oct 16 07:40:49 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:40:49 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:40:49 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:40:49 user nova-compute[74080]:     </memballoon>
Oct 16 07:40:49 user nova-compute[74080]:   </devices>
Oct 16 07:40:49 user nova-compute[74080]: </domain>
Oct 16 07:40:49 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1492485079',display_name='tempest-VolumesSnapshotTestJSON-instance-1492485079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1492485079',id=30,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxZSP2FWXmFm13pKrU2RlH3TeRY0wSePQm2TY3KlnJfnz9RtV8lLLkRZXG+g3+EAgvixXC3z9kAEjYTiu5o+4eFT65HrmvE/gu25IraPa+/dZIzDvHSWgwUy+AQBSruLw==',key_name='tempest-keypair-587015676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dbb580495c34728bb3d06e92842737d',ramdisk_id='',reservation_id='r-60qt8c7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-389413629',owner_user_name='tempest-VolumesSnapshotTestJSON-389413629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:40:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69562ed193c74ec0815d41cbe9b662c1',uuid=ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converting VIF {"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:64:ae,bridge_name='br-int',has_traffic_filtering=True,id=38df3710-5b78-4ec5-963b-42f349b9c387,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38df3710-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG os_vif [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:64:ae,bridge_name='br-int',has_traffic_filtering=True,id=38df3710-5b78-4ec5-963b-42f349b9c387,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38df3710-5b') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce5a3646-e1fb-5c5c-a7c6-5f4525ab9f60', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38df3710-5b, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38df3710-5b, col_values=(('qos', UUID('c66b189b-f38f-4bc9-800d-6e5cbccb8a95')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38df3710-5b, col_values=(('external_ids', {'iface-id': '38df3710-5b78-4ec5-963b-42f349b9c387', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:64:ae', 'vm-uuid': 'ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:50 user nova-compute[74080]: INFO os_vif [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:64:ae,bridge_name='br-int',has_traffic_filtering=True,id=38df3710-5b78-4ec5-963b-42f349b9c387,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38df3710-5b')
Oct 16 07:40:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No VIF found with MAC fa:16:3e:38:64:ae, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Updated VIF entry in instance network info cache for port 38df3710-5b78-4ec5-963b-42f349b9c387. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Updating instance_info_cache with network_info: [{"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:40:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-23791b8f-564d-4c17-9774-736e2af13fd8 req-d58226ad-97a5-43f1-a554-a19fa1823a18 service nova] Releasing lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-134601d6-2e50-4620-9841-fcf718ed7278 req-186ac5d3-f851-4194-be40-f7ea12eb0fe3 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-134601d6-2e50-4620-9841-fcf718ed7278 req-186ac5d3-f851-4194-be40-f7ea12eb0fe3 service nova] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-134601d6-2e50-4620-9841-fcf718ed7278 req-186ac5d3-f851-4194-be40-f7ea12eb0fe3 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-134601d6-2e50-4620-9841-fcf718ed7278 req-186ac5d3-f851-4194-be40-f7ea12eb0fe3 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-134601d6-2e50-4620-9841-fcf718ed7278 req-186ac5d3-f851-4194-be40-f7ea12eb0fe3 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] No waiting events found dispatching network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:51 user nova-compute[74080]: WARNING nova.compute.manager [req-134601d6-2e50-4620-9841-fcf718ed7278 req-186ac5d3-f851-4194-be40-f7ea12eb0fe3 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received unexpected event network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 for instance with vm_state building and task_state spawning.
Oct 16 07:40:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:40:53 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Instance spawned successfully.
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-ef57c344-76f9-4190-977e-eafc3c61567a req-0e136795-f5b8-49fc-9ec9-d121d5ddb721 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ef57c344-76f9-4190-977e-eafc3c61567a req-0e136795-f5b8-49fc-9ec9-d121d5ddb721 service nova] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ef57c344-76f9-4190-977e-eafc3c61567a req-0e136795-f5b8-49fc-9ec9-d121d5ddb721 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ef57c344-76f9-4190-977e-eafc3c61567a req-0e136795-f5b8-49fc-9ec9-d121d5ddb721 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-ef57c344-76f9-4190-977e-eafc3c61567a req-0e136795-f5b8-49fc-9ec9-d121d5ddb721 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] No waiting events found dispatching network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:40:53 user nova-compute[74080]: WARNING nova.compute.manager [req-ef57c344-76f9-4190-977e-eafc3c61567a req-0e136795-f5b8-49fc-9ec9-d121d5ddb721 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received unexpected event network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 for instance with vm_state building and task_state spawning.
Oct 16 07:40:53 user nova-compute[74080]: INFO nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 16 07:40:53 user nova-compute[74080]: DEBUG nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:40:53 user nova-compute[74080]: INFO nova.compute.manager [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Took 6.26 seconds to build instance.
Oct 16 07:40:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-ecd50430-39bb-40b8-8af2-cd996a1ec711 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.355s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:40:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:40:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:00 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:41:01 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Creating image(s)
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:01 user nova-compute[74080]: INFO nova.compute.manager [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Rescuing
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquired lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG nova.network.neutron [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.264s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.218s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk 1073741824" returned: 0 in 0.053s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.network.neutron [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Updating instance_info_cache with network_info: [{"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Releasing lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Cannot resize image /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Ensure instance console log exists: /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Start _get_guest_xml network_info=[{"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '672bf6a3-5832-4927-b83a-7f236f29568c', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd78e592d-691e-4fa1-9840-8f436fa17f0d', 'attached_at': '', 'detached_at': '', 'volume_id': '6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'serial': '6c3a1050-fb68-46fe-b2e0-d6d6eb03938d'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:41:02 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 07:41:02 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'vcpu_model' on Instance uuid d78e592d-691e-4fa1-9840-8f436fa17f0d {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:41:02 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:41:02 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:41:02 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[06030c59-d3eb-4838-9366-bcdf535a4f29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:41:02 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce56bac-97e3-46aa-b9c1-a7acea590eef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d] added
Oct 16 07:41:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0554d7-ab08-4b7f-bf95-c82203980bf3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05cd626-7a91-4904-905b-51c4ffe08b3a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeaYpBEt {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IeaYpBEt" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf253707-d9dc-4b1f-b6c6-5dee3d00ad02]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IeaYpBEt'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.compute.manager [req-a76e3a7e-6e42-426b-9ca8-093c53a6e17f req-7e4b1c01-6ff9-4513-b43b-b6cea89422f6 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-unplugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a76e3a7e-6e42-426b-9ca8-093c53a6e17f req-7e4b1c01-6ff9-4513-b43b-b6cea89422f6 service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a76e3a7e-6e42-426b-9ca8-093c53a6e17f req-7e4b1c01-6ff9-4513-b43b-b6cea89422f6 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a76e3a7e-6e42-426b-9ca8-093c53a6e17f req-7e4b1c01-6ff9-4513-b43b-b6cea89422f6 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.compute.manager [req-a76e3a7e-6e42-426b-9ca8-093c53a6e17f req-7e4b1c01-6ff9-4513-b43b-b6cea89422f6 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-unplugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:02 user nova-compute[74080]: WARNING nova.compute.manager [req-a76e3a7e-6e42-426b-9ca8-093c53a6e17f req-7e4b1c01-6ff9-4513-b43b-b6cea89422f6 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-unplugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:02 user nova-compute[74080]: INFO nova.compute.manager [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Terminating instance
Oct 16 07:41:02 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a88a859-899e-45c3-89af-5abac587f0f5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab083a6-fe25-4409-97e6-422f210d1912]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e648616-e87b-49bd-9f38-e8327566aa49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]
Oct 16 07:41:02 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.
Oct 16 07:41:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7b45d-a9a3-48d2-bd86-5c8ade351ea3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecdf342-33fd-4a89-b76a-7170abd55b3d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:41:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:02 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:41:02 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec46671d-9afa-4d24-887c-7710bd25ffed]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:41:02 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:41:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance destroyed successfully.
Oct 16 07:41:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Attempting a stable device rescue
Oct 16 07:41:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 07:41:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance directory exists: not creating {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 07:41:03 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Creating image(s)
Oct 16 07:41:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "/opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "/opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:03 user nova-compute[74080]: DEBUG nova.objects.instance [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "1b0780a8125e7b985b19ace3697716c41dc8e42f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "1b0780a8125e7b985b19ace3697716c41dc8e42f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.954s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== connect_volume: return (1959ms) {'type': 'block', 'scsi_wwn': '26661376161313731', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661376161313731', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:41:04 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Instance destroyed successfully.
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'resources' on Instance uuid e3ce6a9c-4f1f-44c0-abd6-3c490d23a720 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1099651142',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1099651142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1099651142',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTWN2A16k7Ru/tPKCuVHOXXo+Z7HzJvAzLv9fvSEYYdoo5hEzaed8ob3Zvx8Y0FOWPCz3ad+0OH5rq4gnJfIMZYYEQk8hxoD3k0Ql0rpRzWTlJChX6p/puoAIL50dYpEA==',key_name='tempest-keypair-756091481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:35:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-k17unw70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:35:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33b58ae309d047548ebf29684db6037e',uuid=e3ce6a9c-4f1f-44c0-abd6-3c490d23a720,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "address": "fa:16:3e:9e:a1:ca", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd031f99d-6f", "ovs_interfaceid": "d031f99d-6fdb-4d4f-b369-023c5f5463aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:ca,bridge_name='br-int',has_traffic_filtering=True,id=d031f99d-6fdb-4d4f-b369-023c5f5463aa,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031f99d-6f') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_vif [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:ca,bridge_name='br-int',has_traffic_filtering=True,id=d031f99d-6fdb-4d4f-b369-023c5f5463aa,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031f99d-6f') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd031f99d-6f, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-42157221',display_name='tempest-ServerActionsTestOtherA-server-2101783169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-42157221',id=25,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs9QYYmApPo/IdFZYUpvJuopfWBor9lAxprFyaOW8mIlMKQXXtBqQiy+txKogOD/oYyzWsOFmEbKYoQGKozjO5zcNKMNfcxjhdCxwKZf85uWPefm0SbTBKdqNOzO4jZ/g==',key_name='tempest-keypair-676640173',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-dta6ryi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=d78e592d-691e-4fa1-9840-8f436fa17f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:41:04 user nova-compute[74080]:   <uuid>d78e592d-691e-4fa1-9840-8f436fa17f0d</uuid>
Oct 16 07:41:04 user nova-compute[74080]:   <name>instance-00000019</name>
Oct 16 07:41:04 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:41:04 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:41:04 user nova-compute[74080]:   <metadata>
Oct 16 07:41:04 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:41:04 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:41:04 user nova-compute[74080]:       <nova:name>tempest-ServerActionsTestOtherA-server-2101783169</nova:name>
Oct 16 07:41:04 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:41:02</nova:creationTime>
Oct 16 07:41:04 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:41:04 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:41:04 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:41:04 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:41:04 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:41:04 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:41:04 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:41:04 user nova-compute[74080]:       <nova:owner>
Oct 16 07:41:04 user nova-compute[74080]:         <nova:user uuid="0c63d981ba0f4e5fa162e8f2cd6064b9">tempest-ServerActionsTestOtherA-481627845-project-member</nova:user>
Oct 16 07:41:04 user nova-compute[74080]:         <nova:project uuid="0ee952431351406291cab2310d4a54fd">tempest-ServerActionsTestOtherA-481627845</nova:project>
Oct 16 07:41:04 user nova-compute[74080]:       </nova:owner>
Oct 16 07:41:04 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:41:04 user nova-compute[74080]:       <nova:ports>
Oct 16 07:41:04 user nova-compute[74080]:         <nova:port uuid="e8c3048c-e1f4-4b03-86cc-eb194060a682">
Oct 16 07:41:04 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:41:04 user nova-compute[74080]:         </nova:port>
Oct 16 07:41:04 user nova-compute[74080]:       </nova:ports>
Oct 16 07:41:04 user nova-compute[74080]:     </nova:instance>
Oct 16 07:41:04 user nova-compute[74080]:   </metadata>
Oct 16 07:41:04 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:41:04 user nova-compute[74080]:     <system>
Oct 16 07:41:04 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:41:04 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:41:04 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:41:04 user nova-compute[74080]:       <entry name="serial">d78e592d-691e-4fa1-9840-8f436fa17f0d</entry>
Oct 16 07:41:04 user nova-compute[74080]:       <entry name="uuid">d78e592d-691e-4fa1-9840-8f436fa17f0d</entry>
Oct 16 07:41:04 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:41:04 user nova-compute[74080]:     </system>
Oct 16 07:41:04 user nova-compute[74080]:   </sysinfo>
Oct 16 07:41:04 user nova-compute[74080]:   <os>
Oct 16 07:41:04 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:41:04 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:41:04 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:41:04 user nova-compute[74080]:   </os>
Oct 16 07:41:04 user nova-compute[74080]:   <features>
Oct 16 07:41:04 user nova-compute[74080]:     <acpi/>
Oct 16 07:41:04 user nova-compute[74080]:     <apic/>
Oct 16 07:41:04 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:41:04 user nova-compute[74080]:   </features>
Oct 16 07:41:04 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:41:04 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:41:04 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:41:04 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:41:04 user nova-compute[74080]:   </clock>
Oct 16 07:41:04 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:41:04 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:41:04 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:41:04 user nova-compute[74080]:   </cpu>
Oct 16 07:41:04 user nova-compute[74080]:   <devices>
Oct 16 07:41:04 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:41:04 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:41:04 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk"/>
Oct 16 07:41:04 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:41:04 user nova-compute[74080]:     </disk>
Oct 16 07:41:04 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:41:04 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:41:04 user nova-compute[74080]:       <source dev="/dev/sdd"/>
Oct 16 07:41:04 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:41:04 user nova-compute[74080]:       <serial>6c3a1050-fb68-46fe-b2e0-d6d6eb03938d</serial>
Oct 16 07:41:04 user nova-compute[74080]:     </disk>
Oct 16 07:41:04 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:41:04 user nova-compute[74080]:       <mac address="fa:16:3e:cb:9a:c4"/>
Oct 16 07:41:04 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:04 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:41:04 user nova-compute[74080]:       <target dev="tape8c3048c-e1"/>
Oct 16 07:41:04 user nova-compute[74080]:     </interface>
Oct 16 07:41:04 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:41:04 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/console.log" append="off"/>
Oct 16 07:41:04 user nova-compute[74080]:     </serial>
Oct 16 07:41:04 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:41:04 user nova-compute[74080]:     <video>
Oct 16 07:41:04 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:04 user nova-compute[74080]:     </video>
Oct 16 07:41:04 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:41:04 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:41:04 user nova-compute[74080]:     </rng>
Oct 16 07:41:04 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:41:04 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:41:04 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:41:04 user nova-compute[74080]:     </memballoon>
Oct 16 07:41:04 user nova-compute[74080]:   </devices>
Oct 16 07:41:04 user nova-compute[74080]: </domain>
Oct 16 07:41:04 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-42157221',display_name='tempest-ServerActionsTestOtherA-server-2101783169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-42157221',id=25,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs9QYYmApPo/IdFZYUpvJuopfWBor9lAxprFyaOW8mIlMKQXXtBqQiy+txKogOD/oYyzWsOFmEbKYoQGKozjO5zcNKMNfcxjhdCxwKZf85uWPefm0SbTBKdqNOzO4jZ/g==',key_name='tempest-keypair-676640173',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:37:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-dta6ryi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=d78e592d-691e-4fa1-9840-8f436fa17f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_vif [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f9bca74-d89d-4a54-8dec-9de18915250c) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7b92e1c-e0e4-5115-ba34-ec7984741067', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:04 user nova-compute[74080]: INFO os_vif [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:a1:ca,bridge_name='br-int',has_traffic_filtering=True,id=d031f99d-6fdb-4d4f-b369-023c5f5463aa,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd031f99d-6f')
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgkLQwZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:41:04 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c3048c-e1, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8c3048c-e1, col_values=(('qos', UUID('32bab7a9-5db8-46b4-a07a-b0a24e99289a')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8c3048c-e1, col_values=(('external_ids', {'iface-id': 'e8c3048c-e1f4-4b03-86cc-eb194060a682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:9a:c4', 'vm-uuid': 'd78e592d-691e-4fa1-9840-8f436fa17f0d'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed582dcc-b5a0-4c18-a0e8-bf3ef572a4d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:41:04 user nova-compute[74080]: No targets found.
Oct 16 07:41:04 user nova-compute[74080]: iSNS:
Oct 16 07:41:04 user nova-compute[74080]: No targets found.
Oct 16 07:41:04 user nova-compute[74080]: STATIC:
Oct 16 07:41:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:41:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:41:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:41:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27
Oct 16 07:41:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:41:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:41:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:41:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:41:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:41:04 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:41:04 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:41:04 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:41:04 user nova-compute[74080]: FIRMWARE:
Oct 16 07:41:04 user nova-compute[74080]: No targets found.
Oct 16 07:41:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:41:04 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:41:04 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.part --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.images [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] fcff10fe-5049-4a39-bcc9-ce1d69d65064 was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.part /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0681a278-69d8-430f-bffb-ff2de8ffa16c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: INFO os_vif [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1')
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9cee6c-4573-4adc-a107-0a86b096d3e4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:41:04 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:04 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:04 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:41:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 (non-flash)
Oct 16 07:41:04 user nova-compute[74080]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:04 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:04 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:41:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac223520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27'): ({'sdc'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Removing single pathed devices sdc {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04ae2f4-0896-4b0c-8db3-55557ba21f42]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9a87f5-3608-4165-92bb-47e3b4263ca6]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flushing IO for device /dev/sdc {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No VIF found with MAC fa:16:3e:cb:9a:c4, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d71d78-6d0b-4cdb-ba98-c2e90b1cc83d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:04 user nova-compute[74080]: WARNING nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-vif-unplugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Acquiring lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] No waiting events found dispatching network-vif-unplugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-vif-unplugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Acquiring lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] No waiting events found dispatching network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:04 user nova-compute[74080]: WARNING nova.compute.manager [req-c544be40-ce68-48e6-b44d-2227ba22d927 req-d15d874f-86ac-4630-9b59-766349dc86ec service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received unexpected event network-vif-plugged-d031f99d-6fdb-4d4f-b369-023c5f5463aa for instance with vm_state active and task_state deleting.
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d4909c-3403-48c6-ac32-f09fa95f76b4]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.062s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ccd33-2307-4514-895c-c1c5a2e2934c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.part /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.converted" returned: 0 in 0.314s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca9fc61-fe53-4430-aa33-2b4ae764b1dd]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260]
Oct 16 07:41:04 user nova-compute[74080]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27, portal: 172.16.0.220,3260] successful.
Oct 16 07:41:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc0f562e-a323-42a0-b334-08353259cb27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113da1b-7ebc-4a89-b092-63065a5d6dc8]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.474s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== disconnect_volume: return (476ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:41:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:41:04 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Deleting instance files /opt/stack/data/nova/instances/e3ce6a9c-4f1f-44c0-abd6-3c490d23a720_del
Oct 16 07:41:04 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Deletion of /opt/stack/data/nova/instances/e3ce6a9c-4f1f-44c0-abd6-3c490d23a720_del complete
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "1b0780a8125e7b985b19ace3697716c41dc8e42f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.866s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "1b0780a8125e7b985b19ace3697716c41dc8e42f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "1b0780a8125e7b985b19ace3697716c41dc8e42f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: INFO nova.compute.manager [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Took 2.44 seconds to destroy the instance on the hypervisor.
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f --force-share --output=json" returned: 0 in 0.172s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f,backing_fmt=raw /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b0780a8125e7b985b19ace3697716c41dc8e42f,backing_fmt=raw /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue" returned: 0 in 0.053s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "1b0780a8125e7b985b19ace3697716c41dc8e42f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'migration_context' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Object Instance<5a35de85-4095-4a93-8d33-a4577b960b95> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Start _get_guest_xml network_info=[{"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "vif_mac": "fa:16:3e:f1:82:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fcff10fe-5049-4a39-bcc9-ce1d69d65064', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '2e934665-80a5-4c2a-86bd-101362ef56b1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmFsvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5a35de85-4095-4a93-8d33-a4577b960b95', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7981707-d7a7-4db0-bd60-4d86f01386c5', 'serial': 'e7981707-d7a7-4db0-bd60-4d86f01386c5'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'resources' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Object Instance<5a35de85-4095-4a93-8d33-a4577b960b95> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Object Instance<5a35de85-4095-4a93-8d33-a4577b960b95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:05 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:05 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Object Instance<5a35de85-4095-4a93-8d33-a4577b960b95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmFsvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:41:05 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:41:05 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:41:05 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05928df-e2f9-4e6c-b839-aed90e9ec601]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AzSmFsvt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 07:41:05 user nova-compute[74080]: node.name = iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:41:05 user nova-compute[74080]: node.tpgt = -1
Oct 16 07:41:05 user nova-compute[74080]: node.startup = automatic
Oct 16 07:41:05 user nova-compute[74080]: node.leading_login = No
Oct 16 07:41:05 user nova-compute[74080]: iface.iscsi_ifacename = default
Oct 16 07:41:05 user nova-compute[74080]: iface.net_ifacename = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.ipaddress = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.prefix_len = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.hwaddress = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.transport_name = tcp
Oct 16 07:41:05 user nova-compute[74080]: iface.initiatorname = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.state = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.vlan_id = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.vlan_priority = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.vlan_state = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.iface_num = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.mtu = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.port = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.bootproto = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.subnet_mask = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.gateway = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_alt_client_id = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_dns = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_learn_iqn = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_vendor_id_state = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_vendor_id = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.dhcp_slp_da = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.fragmentation = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.gratuitous_arp = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.incoming_forwarding = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.tos_state = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.tos = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.ttl = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.delayed_ack = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.tcp_nagle = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.tcp_wsf_state = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.tcp_wsf = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.tcp_timer_scale = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.tcp_timestamp = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.redirect = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.def_task_mgmt_timeout = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.header_digest = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.data_digest = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.immediate_data = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.initial_r2t = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.data_seq_inorder = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.data_pdu_inorder = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.erl = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.max_receive_data_len = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.first_burst_len = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.max_outstanding_r2t = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.max_burst_len = 0
Oct 16 07:41:05 user nova-compute[74080]: iface.chap_auth = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.bidi_chap = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.strict_login_compliance = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.discovery_auth = <empty>
Oct 16 07:41:05 user nova-compute[74080]: iface.discovery_logout = <empty>
Oct 16 07:41:05 user nova-compute[74080]: node.discovery_address = <empty>
Oct 16 07:41:05 user nova-compute[74080]: node.discovery_port = 0
Oct 16 07:41:05 user nova-compute[74080]: node.discovery_type = static
Oct 16 07:41:05 user nova-compute[74080]: node.session.initial_cmdsn = 0
Oct 16 07:41:05 user nova-compute[74080]: node.session.initial_login_retry_max = 8
Oct 16 07:41:05 user nova-compute[74080]: node.session.xmit_thread_priority = -20
Oct 16 07:41:05 user nova-compute[74080]: node.session.cmds_max = 128
Oct 16 07:41:05 user nova-compute[74080]: node.session.queue_depth = 32
Oct 16 07:41:05 user nova-compute[74080]: node.session.nr_sessions = 1
Oct 16 07:41:05 user nova-compute[74080]: node.session.auth.authmethod = CHAP
Oct 16 07:41:05 user nova-compute[74080]: node.session.auth.username = AzSmFsvt
Oct 16 07:41:05 user nova-compute[74080]: node.session.auth.password = ***
Oct 16 07:41:05 user nova-compute[74080]: node.session.auth.username_in = <empty>
Oct 16 07:41:05 user nova-compute[74080]: node.session.auth.password_in = <empty>
Oct 16 07:41:05 user nova-compute[74080]: node.session.auth.chap_algs = MD5
Oct 16 07:41:05 user nova-compute[74080]: node.session.timeo.replacement_timeout = 120
Oct 16 07:41:05 user nova-compute[74080]: node.session.err_timeo.abort_timeout = 15
Oct 16 07:41:05 user nova-compute[74080]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 07:41:05 user nova-compute[74080]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 07:41:05 user nova-compute[74080]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.FastAbort = Yes
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.InitialR2T = No
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.ImmediateData = Yes
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.MaxConnections = 1
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 07:41:05 user nova-compute[74080]: node.session.iscsi.ERL = 0
Oct 16 07:41:05 user nova-compute[74080]: node.session.scan = manual
Oct 16 07:41:05 user nova-compute[74080]: node.session.reopen_max = 0
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].address = 172.16.0.220
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].port = 3260
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].startup = manual
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].tcp.window_size = 524288
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].tcp.type_of_service = 0
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].timeo.logout_timeout = 15
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].timeo.login_timeout = 15
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].timeo.auth_timeout = 45
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].iscsi.DataDigest = None
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].iscsi.IFMarker = No
Oct 16 07:41:05 user nova-compute[74080]: node.conn[0].iscsi.OFMarker = No
Oct 16 07:41:05 user nova-compute[74080]: # END RECORD
Oct 16 07:41:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f03109-3c21-4fbe-9718-7ddf1a8b3dc1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b0aceb-29ac-41d6-b302-26058ed2dfb9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzSmFsvt {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzSmFsvt" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb72796-263f-4356-a119-d383d45472a7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AzSmFsvt'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bcf54d-d6bf-4842-a2ef-2e7ff7d0535f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa2059e-f08f-4199-99ca-4ba2d73c91e8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:05 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:41:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:41:05 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:41:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:41:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] HCTL ('37', '0', '0', 0) found on session 32 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ce0982-537b-413a-8f26-d9e813c7fc08]: (4, ('0 0 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching for a device in session 32 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmFsvt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] <== connect_volume: return (233ms) {'type': 'block', 'scsi_wwn': '23065343266343766', 'path': '/dev/sdf'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065343266343766', 'path': '/dev/sdf'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:38:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1588867210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1588867210',id=26,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-9hl29b0b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:39:21Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=5a35de85-4095-4a93-8d33-a4577b960b95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "vif_mac": "fa:16:3e:f1:82:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "vif_mac": "fa:16:3e:f1:82:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:82:50,bridge_name='br-int',has_traffic_filtering=True,id=428a165b-6148-4fe5-a539-dad7bbb9a399,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap428a165b-61') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.objects.base [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Object Instance<5a35de85-4095-4a93-8d33-a4577b960b95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:41:05 user nova-compute[74080]:   <uuid>5a35de85-4095-4a93-8d33-a4577b960b95</uuid>
Oct 16 07:41:05 user nova-compute[74080]:   <name>instance-0000001a</name>
Oct 16 07:41:05 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:41:05 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:41:05 user nova-compute[74080]:   <metadata>
Oct 16 07:41:05 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:41:05 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:41:05 user nova-compute[74080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1588867210</nova:name>
Oct 16 07:41:05 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:41:05</nova:creationTime>
Oct 16 07:41:05 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:41:05 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:41:05 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:41:05 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:41:05 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:41:05 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:41:05 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:41:05 user nova-compute[74080]:       <nova:owner>
Oct 16 07:41:05 user nova-compute[74080]:         <nova:user uuid="bf2fbffe5a5544dba338662d437d5ee2">tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member</nova:user>
Oct 16 07:41:05 user nova-compute[74080]:         <nova:project uuid="cea8d62574f84ae6a83ee19b7b03c21a">tempest-ServerBootFromVolumeStableRescueTest-1639701158</nova:project>
Oct 16 07:41:05 user nova-compute[74080]:       </nova:owner>
Oct 16 07:41:05 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:41:05 user nova-compute[74080]:       <nova:ports>
Oct 16 07:41:05 user nova-compute[74080]:         <nova:port uuid="428a165b-6148-4fe5-a539-dad7bbb9a399">
Oct 16 07:41:05 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 07:41:05 user nova-compute[74080]:         </nova:port>
Oct 16 07:41:05 user nova-compute[74080]:       </nova:ports>
Oct 16 07:41:05 user nova-compute[74080]:     </nova:instance>
Oct 16 07:41:05 user nova-compute[74080]:   </metadata>
Oct 16 07:41:05 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:41:05 user nova-compute[74080]:     <system>
Oct 16 07:41:05 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:41:05 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:41:05 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:41:05 user nova-compute[74080]:       <entry name="serial">5a35de85-4095-4a93-8d33-a4577b960b95</entry>
Oct 16 07:41:05 user nova-compute[74080]:       <entry name="uuid">5a35de85-4095-4a93-8d33-a4577b960b95</entry>
Oct 16 07:41:05 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:41:05 user nova-compute[74080]:     </system>
Oct 16 07:41:05 user nova-compute[74080]:   </sysinfo>
Oct 16 07:41:05 user nova-compute[74080]:   <os>
Oct 16 07:41:05 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:41:05 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:41:05 user nova-compute[74080]:   </os>
Oct 16 07:41:05 user nova-compute[74080]:   <features>
Oct 16 07:41:05 user nova-compute[74080]:     <acpi/>
Oct 16 07:41:05 user nova-compute[74080]:     <apic/>
Oct 16 07:41:05 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:41:05 user nova-compute[74080]:   </features>
Oct 16 07:41:05 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:41:05 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:41:05 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:41:05 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:41:05 user nova-compute[74080]:   </clock>
Oct 16 07:41:05 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:41:05 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:41:05 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:41:05 user nova-compute[74080]:   </cpu>
Oct 16 07:41:05 user nova-compute[74080]:   <devices>
Oct 16 07:41:05 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:41:05 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:41:05 user nova-compute[74080]:       <source dev="/dev/sdf"/>
Oct 16 07:41:05 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:41:05 user nova-compute[74080]:       <serial>e7981707-d7a7-4db0-bd60-4d86f01386c5</serial>
Oct 16 07:41:05 user nova-compute[74080]:     </disk>
Oct 16 07:41:05 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:41:05 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:41:05 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue"/>
Oct 16 07:41:05 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:41:05 user nova-compute[74080]:       <boot order="1"/>
Oct 16 07:41:05 user nova-compute[74080]:     </disk>
Oct 16 07:41:05 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:41:05 user nova-compute[74080]:       <mac address="fa:16:3e:f1:82:50"/>
Oct 16 07:41:05 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:05 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:41:05 user nova-compute[74080]:       <target dev="tap428a165b-61"/>
Oct 16 07:41:05 user nova-compute[74080]:     </interface>
Oct 16 07:41:05 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:41:05 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/console.log" append="off"/>
Oct 16 07:41:05 user nova-compute[74080]:     </serial>
Oct 16 07:41:05 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:41:05 user nova-compute[74080]:     <video>
Oct 16 07:41:05 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:05 user nova-compute[74080]:     </video>
Oct 16 07:41:05 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:41:05 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:41:05 user nova-compute[74080]:     </rng>
Oct 16 07:41:05 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:41:05 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:41:05 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:41:05 user nova-compute[74080]:     </memballoon>
Oct 16 07:41:05 user nova-compute[74080]:   </devices>
Oct 16 07:41:05 user nova-compute[74080]: </domain>
Oct 16 07:41:05 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:41:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance destroyed successfully.
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:41:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No VIF found with MAC fa:16:3e:f1:82:50, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-f45ffb5b-56c2-44c1-8e78-0d4461fad236 req-0588797c-86ba-45cb-9063-9748193e85fa service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f45ffb5b-56c2-44c1-8e78-0d4461fad236 req-0588797c-86ba-45cb-9063-9748193e85fa service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f45ffb5b-56c2-44c1-8e78-0d4461fad236 req-0588797c-86ba-45cb-9063-9748193e85fa service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f45ffb5b-56c2-44c1-8e78-0d4461fad236 req-0588797c-86ba-45cb-9063-9748193e85fa service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-f45ffb5b-56c2-44c1-8e78-0d4461fad236 req-0588797c-86ba-45cb-9063-9748193e85fa service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:06 user nova-compute[74080]: WARNING nova.compute.manager [req-f45ffb5b-56c2-44c1-8e78-0d4461fad236 req-0588797c-86ba-45cb-9063-9748193e85fa service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received unexpected event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 07:41:06 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:06 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Took 1.52 seconds to deallocate network for instance.
Oct 16 07:41:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-58609985-6496-4bc7-806b-17f38b6a6fe5 req-563c2d65-416a-49fd-93a7-71f3bdb71087 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-58609985-6496-4bc7-806b-17f38b6a6fe5 req-563c2d65-416a-49fd-93a7-71f3bdb71087 service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-58609985-6496-4bc7-806b-17f38b6a6fe5 req-563c2d65-416a-49fd-93a7-71f3bdb71087 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-58609985-6496-4bc7-806b-17f38b6a6fe5 req-563c2d65-416a-49fd-93a7-71f3bdb71087 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-58609985-6496-4bc7-806b-17f38b6a6fe5 req-563c2d65-416a-49fd-93a7-71f3bdb71087 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:07 user nova-compute[74080]: WARNING nova.compute.manager [req-58609985-6496-4bc7-806b-17f38b6a6fe5 req-563c2d65-416a-49fd-93a7-71f3bdb71087 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-2a2ab8db-4e3a-4fdd-a476-b2e6b2b05160 req-aab0e66b-3373-4f65-86f0-0a3a26836515 service nova] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Received event network-vif-deleted-d031f99d-6fdb-4d4f-b369-023c5f5463aa {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-2a2ab8db-4e3a-4fdd-a476-b2e6b2b05160 req-aab0e66b-3373-4f65-86f0-0a3a26836515 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a2ab8db-4e3a-4fdd-a476-b2e6b2b05160 req-aab0e66b-3373-4f65-86f0-0a3a26836515 service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a2ab8db-4e3a-4fdd-a476-b2e6b2b05160 req-aab0e66b-3373-4f65-86f0-0a3a26836515 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a2ab8db-4e3a-4fdd-a476-b2e6b2b05160 req-aab0e66b-3373-4f65-86f0-0a3a26836515 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-2a2ab8db-4e3a-4fdd-a476-b2e6b2b05160 req-aab0e66b-3373-4f65-86f0-0a3a26836515 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:08 user nova-compute[74080]: WARNING nova.compute.manager [req-2a2ab8db-4e3a-4fdd-a476-b2e6b2b05160 req-aab0e66b-3373-4f65-86f0-0a3a26836515 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received unexpected event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with vm_state active and task_state rebuild_spawning.
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:41:09 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance spawned successfully.
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74080) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f0c4d650-9fc0-4d0c-9a57-887c779437b9 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-74310087-93db-47e0-b00e-1eee924bd81c tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-e789d93a-ddb6-481b-a19b-3952214c8745 req-0d4005dc-5562-4b8a-a68c-08bc4855c251 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e789d93a-ddb6-481b-a19b-3952214c8745 req-0d4005dc-5562-4b8a-a68c-08bc4855c251 service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e789d93a-ddb6-481b-a19b-3952214c8745 req-0d4005dc-5562-4b8a-a68c-08bc4855c251 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e789d93a-ddb6-481b-a19b-3952214c8745 req-0d4005dc-5562-4b8a-a68c-08bc4855c251 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-e789d93a-ddb6-481b-a19b-3952214c8745 req-0d4005dc-5562-4b8a-a68c-08bc4855c251 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:09 user nova-compute[74080]: WARNING nova.compute.manager [req-e789d93a-ddb6-481b-a19b-3952214c8745 req-0d4005dc-5562-4b8a-a68c-08bc4855c251 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:10 user nova-compute[74080]: INFO nova.compute.manager [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Took 3.98 seconds to detach 1 volumes for instance.
Oct 16 07:41:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: e3ce6a9c-4f1f-44c0-abd6-3c490d23a720] Deleting volume: bc0f562e-a323-42a0-b334-08353259cb27 {{(pid=74080) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 07:41:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:11 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:41:11 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:41:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:11 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Deleted allocations for instance e3ce6a9c-4f1f-44c0-abd6-3c490d23a720
Oct 16 07:41:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b2f6bf38-204a-46b7-819d-a74068b166b5 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "e3ce6a9c-4f1f-44c0-abd6-3c490d23a720" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.763s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:19 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Updating instance_info_cache with network_info: [{"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquired lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'info_cache' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:23 user nova-compute[74080]: DEBUG nova.objects.base [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Releasing lock "refresh_cache-a889e1ab-9c69-4dbb-8a67-79d24bd67678" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:41:24 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance destroyed successfully.
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'resources' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.base [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG os_vif [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fb90376-ac, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc6c4774-d760-426f-800b-4db9cf250528) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:24 user nova-compute[74080]: INFO os_vif [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac')
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Start _get_guest_xml network_info=[{"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'numa_topology' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.base [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:24 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:24 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'vcpu_model' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.base [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'pci_devices' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.objects.base [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:41:24 user nova-compute[74080]:   <uuid>a889e1ab-9c69-4dbb-8a67-79d24bd67678</uuid>
Oct 16 07:41:24 user nova-compute[74080]:   <name>instance-0000000d</name>
Oct 16 07:41:24 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:41:24 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:41:24 user nova-compute[74080]:   <metadata>
Oct 16 07:41:24 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:41:24 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:41:24 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeTestJSON-server-878526387</nova:name>
Oct 16 07:41:24 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:41:24</nova:creationTime>
Oct 16 07:41:24 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:41:24 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:41:24 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:41:24 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:41:24 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:41:24 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:41:24 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:41:24 user nova-compute[74080]:       <nova:owner>
Oct 16 07:41:24 user nova-compute[74080]:         <nova:user uuid="3e555075cd0d49f9af33eb6ebfe8d55a">tempest-AttachVolumeTestJSON-1619996160-project-member</nova:user>
Oct 16 07:41:24 user nova-compute[74080]:         <nova:project uuid="7c87d6996a3e46d19f45367113c987c9">tempest-AttachVolumeTestJSON-1619996160</nova:project>
Oct 16 07:41:24 user nova-compute[74080]:       </nova:owner>
Oct 16 07:41:24 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:41:24 user nova-compute[74080]:       <nova:ports>
Oct 16 07:41:24 user nova-compute[74080]:         <nova:port uuid="8fb90376-ac0a-4d74-8a23-29564ea728a4">
Oct 16 07:41:24 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:41:24 user nova-compute[74080]:         </nova:port>
Oct 16 07:41:24 user nova-compute[74080]:       </nova:ports>
Oct 16 07:41:24 user nova-compute[74080]:     </nova:instance>
Oct 16 07:41:24 user nova-compute[74080]:   </metadata>
Oct 16 07:41:24 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:41:24 user nova-compute[74080]:     <system>
Oct 16 07:41:24 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:41:24 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:41:24 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:41:24 user nova-compute[74080]:       <entry name="serial">a889e1ab-9c69-4dbb-8a67-79d24bd67678</entry>
Oct 16 07:41:24 user nova-compute[74080]:       <entry name="uuid">a889e1ab-9c69-4dbb-8a67-79d24bd67678</entry>
Oct 16 07:41:24 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:41:24 user nova-compute[74080]:     </system>
Oct 16 07:41:24 user nova-compute[74080]:   </sysinfo>
Oct 16 07:41:24 user nova-compute[74080]:   <os>
Oct 16 07:41:24 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:41:24 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:41:24 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:41:24 user nova-compute[74080]:   </os>
Oct 16 07:41:24 user nova-compute[74080]:   <features>
Oct 16 07:41:24 user nova-compute[74080]:     <acpi/>
Oct 16 07:41:24 user nova-compute[74080]:     <apic/>
Oct 16 07:41:24 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:41:24 user nova-compute[74080]:   </features>
Oct 16 07:41:24 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:41:24 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:41:24 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:41:24 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:41:24 user nova-compute[74080]:   </clock>
Oct 16 07:41:24 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:41:24 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:41:24 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:41:24 user nova-compute[74080]:   </cpu>
Oct 16 07:41:24 user nova-compute[74080]:   <devices>
Oct 16 07:41:24 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:41:24 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:41:24 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk"/>
Oct 16 07:41:24 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:41:24 user nova-compute[74080]:     </disk>
Oct 16 07:41:24 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:41:24 user nova-compute[74080]:       <mac address="fa:16:3e:e0:3e:55"/>
Oct 16 07:41:24 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:24 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:41:24 user nova-compute[74080]:       <target dev="tap8fb90376-ac"/>
Oct 16 07:41:24 user nova-compute[74080]:     </interface>
Oct 16 07:41:24 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:41:24 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/console.log" append="off"/>
Oct 16 07:41:24 user nova-compute[74080]:     </serial>
Oct 16 07:41:24 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:41:24 user nova-compute[74080]:     <video>
Oct 16 07:41:24 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:24 user nova-compute[74080]:     </video>
Oct 16 07:41:24 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:41:24 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:41:24 user nova-compute[74080]:     </rng>
Oct 16 07:41:24 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:41:24 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:41:24 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:41:24 user nova-compute[74080]:     </memballoon>
Oct 16 07:41:24 user nova-compute[74080]:   </devices>
Oct 16 07:41:24 user nova-compute[74080]: </domain>
Oct 16 07:41:24 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:41:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'trusted_certs' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.objects.base [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Cannot resize image /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.objects.instance [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'migration_context' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.objects.base [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Object Instance<a889e1ab-9c69-4dbb-8a67-79d24bd67678> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG os_vif [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50b2ca38-57a2-507b-8601-44fb2772180c', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fb90376-ac, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fb90376-ac, col_values=(('qos', UUID('9a2cd6f8-51dc-4d4b-8c6b-0f9af702c46c')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fb90376-ac, col_values=(('external_ids', {'iface-id': '8fb90376-ac0a-4d74-8a23-29564ea728a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:3e:55', 'vm-uuid': 'a889e1ab-9c69-4dbb-8a67-79d24bd67678'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:25 user nova-compute[74080]: INFO os_vif [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac')
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-34fd9a1c-69e3-4820-b788-91ee3bf7cbfa req-1680125b-92cd-434b-a439-4c253a74e708 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-34fd9a1c-69e3-4820-b788-91ee3bf7cbfa req-1680125b-92cd-434b-a439-4c253a74e708 service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-34fd9a1c-69e3-4820-b788-91ee3bf7cbfa req-1680125b-92cd-434b-a439-4c253a74e708 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-34fd9a1c-69e3-4820-b788-91ee3bf7cbfa req-1680125b-92cd-434b-a439-4c253a74e708 service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-34fd9a1c-69e3-4820-b788-91ee3bf7cbfa req-1680125b-92cd-434b-a439-4c253a74e708 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:27 user nova-compute[74080]: WARNING nova.compute.manager [req-34fd9a1c-69e3-4820-b788-91ee3bf7cbfa req-1680125b-92cd-434b-a439-4c253a74e708 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state stopped and task_state powering-on.
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-changed-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Refreshing instance network info cache due to event network-changed-84c948a4-99bd-4493-acd7-c5b45d3211c3. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] Acquiring lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] Acquired lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG nova.network.neutron [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Refreshing network info cache for port 84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Updated VIF entry in instance network info cache for port 84c948a4-99bd-4493-acd7-c5b45d3211c3. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Updating instance_info_cache with network_info: [{"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bede60f0-c3c3-4147-a10c-cbcd437432e8 req-ab394d0d-7932-47a6-91ba-712daa469e4b service nova] Releasing lock "refresh_cache-64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:41:29 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance rebooted successfully.
Oct 16 07:41:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-65bfa882-8d7e-4d82-b8df-668457f0708d tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-f199b9ee-c45c-4775-9143-2b45b2da71a8 req-2734b99d-24e4-423e-bc53-858d48f2347b service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f199b9ee-c45c-4775-9143-2b45b2da71a8 req-2734b99d-24e4-423e-bc53-858d48f2347b service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f199b9ee-c45c-4775-9143-2b45b2da71a8 req-2734b99d-24e4-423e-bc53-858d48f2347b service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f199b9ee-c45c-4775-9143-2b45b2da71a8 req-2734b99d-24e4-423e-bc53-858d48f2347b service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-f199b9ee-c45c-4775-9143-2b45b2da71a8 req-2734b99d-24e4-423e-bc53-858d48f2347b service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:29 user nova-compute[74080]: WARNING nova.compute.manager [req-f199b9ee-c45c-4775-9143-2b45b2da71a8 req-2734b99d-24e4-423e-bc53-858d48f2347b service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state active and task_state None.
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:30 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:30 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=25.081199645996094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d78e592d-691e-4fa1-9840-8f436fa17f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:41:30 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:41:31 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:41:31 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:41:31 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:41:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:32 user nova-compute[74080]: INFO nova.compute.manager [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Attaching volume 4c74421f-bd92-4842-830a-18b5fdfc57e9 to /dev/vdb
Oct 16 07:41:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG os_brick.utils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286be38-fcdd-42e9-a008-262055193dd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d67e5d-c1a6-4899-bd8e-1de3c2f0687c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15d3a64-7c87-4081-831c-07d85be77cd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7000b98f-d3f0-4eb4-8161-3ca81ca814d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:41:33 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:41:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c932ef0-83f8-4c24-ba1d-2207618cfe92]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG os_brick.utils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Updating existing volume attachment record: e29698e6-01f2-4837-b18f-061f29fe2f50 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:41:33 user nova-compute[74080]: INFO nova.compute.manager [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Rescuing
Oct 16 07:41:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquired lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updating instance_info_cache with network_info: [{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Releasing lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-3e36b46e-bc02-4272-9168-f5d26c1148dd req-0e174ca0-8c31-4e22-a7f2-d1ff07b951bb service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-unplugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3e36b46e-bc02-4272-9168-f5d26c1148dd req-0e174ca0-8c31-4e22-a7f2-d1ff07b951bb service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3e36b46e-bc02-4272-9168-f5d26c1148dd req-0e174ca0-8c31-4e22-a7f2-d1ff07b951bb service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3e36b46e-bc02-4272-9168-f5d26c1148dd req-0e174ca0-8c31-4e22-a7f2-d1ff07b951bb service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-3e36b46e-bc02-4272-9168-f5d26c1148dd req-0e174ca0-8c31-4e22-a7f2-d1ff07b951bb service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-unplugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:34 user nova-compute[74080]: WARNING nova.compute.manager [req-3e36b46e-bc02-4272-9168-f5d26c1148dd req-0e174ca0-8c31-4e22-a7f2-d1ff07b951bb service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-unplugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance destroyed successfully.
Oct 16 07:41:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Attempting rescue
Oct 16 07:41:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance directory exists: not creating {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 07:41:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Creating image(s)
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'trusted_certs' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.247s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.rescue {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.rescue" returned: 0 in 0.048s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'migration_context' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.base [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<f0dd4404-980e-42a2-a008-05a90d9a5a05> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Start _get_guest_xml network_info=[{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:eb:93:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'resources' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.base [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<f0dd4404-980e-42a2-a008-05a90d9a5a05> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'numa_topology' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.base [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<f0dd4404-980e-42a2-a008-05a90d9a5a05> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:35 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:35 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.base [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<f0dd4404-980e-42a2-a008-05a90d9a5a05> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1586802487',display_name='tempest-ServerRescueNegativeTestJSON-server-1586802487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1586802487',id=22,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-c30rd7yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:36:47Z,user_data=None,user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=f0dd4404-980e-42a2-a008-05a90d9a5a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:eb:93:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:eb:93:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:93:d2,bridge_name='br-int',has_traffic_filtering=True,id=0775ad16-cbd1-4e55-ac5e-669f19cd8f73,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0775ad16-cb') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'pci_devices' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.objects.base [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<f0dd4404-980e-42a2-a008-05a90d9a5a05> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:41:35 user nova-compute[74080]:   <uuid>f0dd4404-980e-42a2-a008-05a90d9a5a05</uuid>
Oct 16 07:41:35 user nova-compute[74080]:   <name>instance-00000016</name>
Oct 16 07:41:35 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:41:35 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:41:35 user nova-compute[74080]:   <metadata>
Oct 16 07:41:35 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:41:35 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:41:35 user nova-compute[74080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1586802487</nova:name>
Oct 16 07:41:35 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:41:35</nova:creationTime>
Oct 16 07:41:35 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:41:35 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:41:35 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:41:35 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:41:35 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:41:35 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:41:35 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:41:35 user nova-compute[74080]:       <nova:owner>
Oct 16 07:41:35 user nova-compute[74080]:         <nova:user uuid="8537fd36ebd340b09c830ab09cd16d0b">tempest-ServerRescueNegativeTestJSON-2029305131-project-member</nova:user>
Oct 16 07:41:35 user nova-compute[74080]:         <nova:project uuid="479d15d0c8ae430096c24dd442ce1e78">tempest-ServerRescueNegativeTestJSON-2029305131</nova:project>
Oct 16 07:41:35 user nova-compute[74080]:       </nova:owner>
Oct 16 07:41:35 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:41:35 user nova-compute[74080]:       <nova:ports>
Oct 16 07:41:35 user nova-compute[74080]:         <nova:port uuid="0775ad16-cbd1-4e55-ac5e-669f19cd8f73">
Oct 16 07:41:35 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 07:41:35 user nova-compute[74080]:         </nova:port>
Oct 16 07:41:35 user nova-compute[74080]:       </nova:ports>
Oct 16 07:41:35 user nova-compute[74080]:     </nova:instance>
Oct 16 07:41:35 user nova-compute[74080]:   </metadata>
Oct 16 07:41:35 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:41:35 user nova-compute[74080]:     <system>
Oct 16 07:41:35 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:41:35 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:41:35 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:41:35 user nova-compute[74080]:       <entry name="serial">f0dd4404-980e-42a2-a008-05a90d9a5a05</entry>
Oct 16 07:41:35 user nova-compute[74080]:       <entry name="uuid">f0dd4404-980e-42a2-a008-05a90d9a5a05</entry>
Oct 16 07:41:35 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:41:35 user nova-compute[74080]:     </system>
Oct 16 07:41:35 user nova-compute[74080]:   </sysinfo>
Oct 16 07:41:35 user nova-compute[74080]:   <os>
Oct 16 07:41:35 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:41:35 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:41:35 user nova-compute[74080]:   </os>
Oct 16 07:41:35 user nova-compute[74080]:   <features>
Oct 16 07:41:35 user nova-compute[74080]:     <acpi/>
Oct 16 07:41:35 user nova-compute[74080]:     <apic/>
Oct 16 07:41:35 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:41:35 user nova-compute[74080]:   </features>
Oct 16 07:41:35 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:41:35 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:41:35 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:41:35 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:41:35 user nova-compute[74080]:   </clock>
Oct 16 07:41:35 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:41:35 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:41:35 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:41:35 user nova-compute[74080]:   </cpu>
Oct 16 07:41:35 user nova-compute[74080]:   <devices>
Oct 16 07:41:35 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:41:35 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:41:35 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.rescue"/>
Oct 16 07:41:35 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:41:35 user nova-compute[74080]:     </disk>
Oct 16 07:41:35 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:41:35 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:41:35 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk"/>
Oct 16 07:41:35 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:41:35 user nova-compute[74080]:     </disk>
Oct 16 07:41:35 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:41:35 user nova-compute[74080]:       <mac address="fa:16:3e:eb:93:d2"/>
Oct 16 07:41:35 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:35 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:41:35 user nova-compute[74080]:       <target dev="tap0775ad16-cb"/>
Oct 16 07:41:35 user nova-compute[74080]:     </interface>
Oct 16 07:41:35 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:41:35 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/console.log" append="off"/>
Oct 16 07:41:35 user nova-compute[74080]:     </serial>
Oct 16 07:41:35 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:41:35 user nova-compute[74080]:     <video>
Oct 16 07:41:35 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:41:35 user nova-compute[74080]:     </video>
Oct 16 07:41:35 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:41:35 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:41:35 user nova-compute[74080]:     </rng>
Oct 16 07:41:35 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:41:35 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:41:35 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:41:35 user nova-compute[74080]:     </memballoon>
Oct 16 07:41:35 user nova-compute[74080]:   </devices>
Oct 16 07:41:35 user nova-compute[74080]: </domain>
Oct 16 07:41:35 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:41:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance destroyed successfully.
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No VIF found with MAC fa:16:3e:eb:93:d2, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:41:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-90be8236-9637-486c-b89a-1cb9215b0723 req-489e324d-627a-414f-9c2c-afb25d2b54e2 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-90be8236-9637-486c-b89a-1cb9215b0723 req-489e324d-627a-414f-9c2c-afb25d2b54e2 service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-90be8236-9637-486c-b89a-1cb9215b0723 req-489e324d-627a-414f-9c2c-afb25d2b54e2 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-90be8236-9637-486c-b89a-1cb9215b0723 req-489e324d-627a-414f-9c2c-afb25d2b54e2 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-90be8236-9637-486c-b89a-1cb9215b0723 req-489e324d-627a-414f-9c2c-afb25d2b54e2 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:36 user nova-compute[74080]: WARNING nova.compute.manager [req-90be8236-9637-486c-b89a-1cb9215b0723 req-489e324d-627a-414f-9c2c-afb25d2b54e2 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:38 user nova-compute[74080]: WARNING nova.compute.manager [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:41:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:41:38 user nova-compute[74080]: WARNING nova.compute.manager [req-d28786e1-4ef7-4de2-9631-26ac6e6e6e58 req-26c1dfad-d2f7-4596-9c51-6ca366a3a03a service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state active and task_state rescuing.
Oct 16 07:41:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e68dc2d9-c60e-4a71-a0d0-b2f37df91167 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:41:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing instance network info cache due to event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG nova.network.neutron [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG nova.network.neutron [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updated VIF entry in instance network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG nova.network.neutron [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a83e41a-0470-4a9b-8341-132ba0990470 req-bb4199e7-ea61-4639-bddd-4810db6c345b service nova] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing instance network info cache due to event network-changed-4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Refreshing network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:41:44 user nova-compute[74080]: INFO nova.compute.manager [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Detaching volume da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:41:44 user nova-compute[74080]: INFO nova.virt.block_device [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Attempting to driver detach volume da228469-2aef-44ec-9590-4267470f6e1b from mountpoint /dev/vdb
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Attempting to detach device vdb from instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:41:44 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:41:44 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:41:44 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:41:44 user nova-compute[74080]:   <serial>da228469-2aef-44ec-9590-4267470f6e1b</serial>
Oct 16 07:41:44 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:41:44 user nova-compute[74080]: </disk>
Oct 16 07:41:44 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:41:44 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully detached device vdb from instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 from the persistent domain config.
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:41:44 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:41:44 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:41:44 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:41:44 user nova-compute[74080]:   <serial>da228469-2aef-44ec-9590-4267470f6e1b</serial>
Oct 16 07:41:44 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:41:44 user nova-compute[74080]: </disk>
Oct 16 07:41:44 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updated VIF entry in instance network info cache for port 4255ae13-23f2-4c25-b194-9c4fc4ed9342. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:41:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7bfee117-564b-49a5-9f5f-c13e827be891 req-69b263cc-97d5-4e34-bdb8-ecabbbc48b05 service nova] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:41:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:41:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:41:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:00 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHBfdPjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:03 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:03 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:03 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing instance network info cache due to event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] Acquiring lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] Acquired lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b926d5c1-0542-4d91-820b-d5a6e1e97e81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:42:03 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f44b1e7-26bf-4fd2-9ada-cfbfef9af6a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9] added
Oct 16 07:42:03 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c5585c-ed79-4508-884e-42f9673e550f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fea71ec-1246-4038-8edd-cc4d69ce5fb4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHBfdPjc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aHBfdPjc" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa8aa5-ef43-4b05-82bd-1b3440e7c852]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aHBfdPjc'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f888767-1909-42bc-8dbd-ea3b84fa4ba5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754c145-4d25-4c32-bf18-e762e4a8c8a3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:03 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:42:03 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:03 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:03 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:42:03 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:03 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:03 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17101aa-9dcd-41a0-8178-1af7f73bd91a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260]
Oct 16 07:42:04 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260] successful.
Oct 16 07:42:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfca4d98-8e79-4049-9eb0-f1c46704555f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bebd19-db07-40c8-90f8-215245176d78]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:04 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:42:04 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:04 user nova-compute[74080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)
Oct 16 07:42:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:04 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:42:04 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:04 user nova-compute[74080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)
Oct 16 07:42:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27128360-2cec-4fdf-8b6a-6da1eece2667]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHBfdPjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG nova.network.neutron [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updated VIF entry in instance network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG nova.network.neutron [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2dd21c0a-c34c-4d99-a7f7-5f30cdc3e01e req-ede9cf29-9bb8-46a7-a18e-6284e6d5a23b service nova] Releasing lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:42:05 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 is timed out.
Oct 16 07:42:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully detached device vdb from instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 from the live domain config.
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsBeMvib', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:05 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23833646531343331', 'path': '/dev/sdc'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833646531343331', 'path': '/dev/sdc'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.039s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:05 user nova-compute[74080]: INFO nova.compute.manager [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] instance snapshotting
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ab514f-70a2-42ca-b830-82b53fd82c1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:42:05 user nova-compute[74080]: No targets found.
Oct 16 07:42:05 user nova-compute[74080]: iSNS:
Oct 16 07:42:05 user nova-compute[74080]: No targets found.
Oct 16 07:42:05 user nova-compute[74080]: STATIC:
Oct 16 07:42:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:42:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:42:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:42:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9
Oct 16 07:42:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:42:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:42:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:42:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:42:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:42:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b
Oct 16 07:42:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:42:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:42:05 user nova-compute[74080]: FIRMWARE:
Oct 16 07:42:05 user nova-compute[74080]: No targets found.
Oct 16 07:42:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:42:05 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:42:05 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:42:05 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:42:05 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:42:05 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:42:05 user nova-compute[74080]:   <serial>4c74421f-bd92-4842-830a-18b5fdfc57e9</serial>
Oct 16 07:42:05 user nova-compute[74080]: </disk>
Oct 16 07:42:05 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9a3795-2157-4ffc-8ba4-dfb084d6dfde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Beginning live snapshot process
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b8836f-dbc2-40ae-8927-97e604b18d0b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:05 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:42:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:05 user nova-compute[74080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)
Oct 16 07:42:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:05 user nova-compute[74080]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b (non-flash)
Oct 16 07:42:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:05 user nova-compute[74080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)
Oct 16 07:42:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac259990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b'): ({'sdb'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Removing single pathed devices sdb {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fd26c5-f8a0-4b9b-9877-c61daff8d559]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c124175-3dde-4f9e-b467-750f25e14fe6]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flushing IO for device /dev/sdb {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab10a9de-dd90-43c1-ace6-a7037a3d7079]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2a1922-429a-431d-8c80-c6087030e6f9]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b025b44-6dd3-4f82-96d5-7f69354d3ec1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e89398d-6d9a-40f8-814c-0e7902164745]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260]
Oct 16 07:42:05 user nova-compute[74080]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b, portal: 172.16.0.220,3260] successful.
Oct 16 07:42:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da228469-2aef-44ec-9590-4267470f6e1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b2f020-6897-4a9b-bebd-f9f58048eab8]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== disconnect_volume: return (396ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] No VIF found with MAC fa:16:3e:59:e2:db, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprrpd8fwr/48fa3fba6ece4255b4113f5b86723f05.delta 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprrpd8fwr/48fa3fba6ece4255b4113f5b86723f05.delta 1073741824" returned: 0 in 0.061s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:06 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 07:42:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e196e35d-d45a-495f-8ffd-5d8c1afb7f83 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.306s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:06 user nova-compute[74080]: INFO nova.compute.manager [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Detaching volume 4c74421f-bd92-4842-830a-18b5fdfc57e9
Oct 16 07:42:06 user nova-compute[74080]: INFO nova.virt.block_device [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Attempting to driver detach volume 4c74421f-bd92-4842-830a-18b5fdfc57e9 from mountpoint /dev/vdb
Oct 16 07:42:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Attempting to detach device vdb from instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:42:06 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:42:06 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:42:06 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:42:06 user nova-compute[74080]:   <serial>4c74421f-bd92-4842-830a-18b5fdfc57e9</serial>
Oct 16 07:42:06 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:42:06 user nova-compute[74080]: </disk>
Oct 16 07:42:06 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:42:06 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully detached device vdb from instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c from the persistent domain config.
Oct 16 07:42:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:42:06 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:42:06 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:42:06 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:42:06 user nova-compute[74080]:   <serial>4c74421f-bd92-4842-830a-18b5fdfc57e9</serial>
Oct 16 07:42:06 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:42:06 user nova-compute[74080]: </disk>
Oct 16 07:42:06 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:42:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:42:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:42:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:42:07 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 07:42:07 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:42:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprrpd8fwr/48fa3fba6ece4255b4113f5b86723f05.delta /opt/stack/data/nova/instances/snapshots/tmprrpd8fwr/48fa3fba6ece4255b4113f5b86723f05 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprrpd8fwr/48fa3fba6ece4255b4113f5b86723f05.delta /opt/stack/data/nova/instances/snapshots/tmprrpd8fwr/48fa3fba6ece4255b4113f5b86723f05" returned: 0 in 0.364s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:07 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Snapshot extracted, beginning image upload
Oct 16 07:42:10 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Snapshot image upload complete
Oct 16 07:42:10 user nova-compute[74080]: INFO nova.compute.manager [None req-4aac6c8f-59c1-4219-bcb1-95f3c9fbefb7 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Took 5.37 seconds to snapshot the instance on the hypervisor.
Oct 16 07:42:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "20180aaa-89c9-42fa-ae42-ded783acb8ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:11 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:42:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:11 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:42:11 user nova-compute[74080]: INFO nova.compute.claims [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Claim successful on node user
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:42:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:42:12 user nova-compute[74080]: INFO nova.virt.block_device [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Booting with volume 6abde53f-ca40-4805-89b6-7274eb9fad84 at /dev/vda
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.policy [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33b58ae309d047548ebf29684db6037e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b70039a31c47f39f7bf1b01b4e6e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG os_brick.utils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc46317-18f2-41d5-b836-d0f0aa32d0cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a8d8eb-cca3-4132-aded-c5ab3c32feab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[621232d5-33c4-4cc3-a481-163f9a67b106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b34c57-67c4-4072-950d-e7fb1b93509b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:42:12 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:42:12 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61b488-7706-4960-9d8f-c480384c2f1d]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG os_brick.utils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Updating existing volume attachment record: 3e7cd52b-7756-45a2-ae46-082c6884c9c7 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Successfully created port: c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Successfully updated port: c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquired lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-changed-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Refreshing instance network info cache due to event network-changed-c0d08985-d438-4228-9608-33f7c2ac6b3a. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] Acquiring lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Updating instance_info_cache with network_info: [{"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Releasing lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Instance network_info: |[{"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] Acquired lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:13 user nova-compute[74080]: DEBUG nova.network.neutron [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Refreshing network info cache for port c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:42:14 user nova-compute[74080]: DEBUG nova.objects.instance [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'flavor' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-626a70ec-f756-4902-8efa-4c19248449e3 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.899s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Updated VIF entry in instance network info cache for port c0d08985-d438-4228-9608-33f7c2ac6b3a. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:42:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Updating instance_info_cache with network_info: [{"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e869f4ab-7b6d-494f-bb57-9ce6fb62cace req-33039745-d7ec-4d06-b667-41792eab30da service nova] Releasing lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [{"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-d2f1f6a7-9bf5-4542-8408-d634e25bbd66" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:20 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:42:24 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:24 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:26 user nova-compute[74080]: INFO nova.compute.manager [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Unshelving
Oct 16 07:42:26 user nova-compute[74080]: INFO nova.virt.block_device [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Booting with volume 6b19066e-062f-425b-9ab5-a7de1989b9c7 at /dev/vdc
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG os_brick.utils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabb7cad-0b4a-4a90-81f0-b54ca1d4df8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa442290-5f1f-4478-a4a1-157928c63f98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f01001-2222-4266-9f4a-74fe49ad4353]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a5a455-1c58-4200-a952-8d721cebe63c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:42:26 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:42:26 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a961465-29fd-4d86-9959-95b4f32123f8]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG os_brick.utils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:26 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating existing volume attachment record: 1c9a15e4-5be7-4a8c-ba08-4fff608b604b {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c is timed out.
Oct 16 07:42:27 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully detached device vdb from instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c from the live domain config.
Oct 16 07:42:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aHBfdPjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:27 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61adc05-c0cf-4b0d-863b-7370327e1d59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:42:27 user nova-compute[74080]: No targets found.
Oct 16 07:42:27 user nova-compute[74080]: iSNS:
Oct 16 07:42:27 user nova-compute[74080]: No targets found.
Oct 16 07:42:27 user nova-compute[74080]: STATIC:
Oct 16 07:42:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:42:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:42:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:42:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9
Oct 16 07:42:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:42:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:42:27 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:42:27 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:42:27 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:42:27 user nova-compute[74080]: FIRMWARE:
Oct 16 07:42:27 user nova-compute[74080]: No targets found.
Oct 16 07:42:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:42:27 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:42:27 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7685e6-0660-4329-a72b-dfc022d84f16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c181e140-46d9-485d-b891-494e6cbb1ed6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:27 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:27 user nova-compute[74080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)
Oct 16 07:42:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:27 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:27 user nova-compute[74080]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 (non-flash)
Oct 16 07:42:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac2216c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9'): ({'sdc'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Removing single pathed devices sdc {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b6e1fd-dde7-4b7f-948e-1d59a814f3bd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a33c75f-a82a-4040-8d4a-8bd6bdcbc705]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Flushing IO for device /dev/sdc {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60da1f7-8a45-4773-b980-be7b32b225c9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab7d9ca-70dc-43a4-8a0e-c38eeebbadde]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b76a0-6f06-4832-8b6a-346f2c7a04ee]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e401bf-b1bb-4629-9d30-65e1aee41e84]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260]
Oct 16 07:42:27 user nova-compute[74080]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9, portal: 172.16.0.220,3260] successful.
Oct 16 07:42:27 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c74421f-bd92-4842-830a-18b5fdfc57e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9610a811-d879-40f8-9e16-a0b8c13242ba]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] <== disconnect_volume: return (393ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:42:28 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Creating image(s)
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Ensure instance console log exists: /opt/stack/data/nova/instances/20180aaa-89c9-42fa-ae42-ded783acb8ec/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Start _get_guest_xml network_info=[{"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3e7cd52b-7756-45a2-ae46-082c6884c9c7', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URGJHYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20180aaa-89c9-42fa-ae42-ded783acb8ec', 'attached_at': '', 'detached_at': '', 'volume_id': '6abde53f-ca40-4805-89b6-7274eb9fad84', 'serial': '6abde53f-ca40-4805-89b6-7274eb9fad84'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:42:28 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URGJHYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:28 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:28 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d107fe8-de7a-43bb-bd19-8910031c62a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:42:28 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bff85ce-63e4-4963-b471-4b5358e8da5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84] added
Oct 16 07:42:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[510e45bd-45f9-4cd9-abad-56b88444671c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7deac1-478c-480b-8e5d-770221d1b69d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URGJHYrh {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URGJHYrh" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e26a274-6705-4b07-aee2-6cc341b9dc81]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URGJHYrh'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c4160d-7dae-4175-9ce3-ddcbb2a2dd59]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[521d83ae-3993-4e9b-bc19-34e8140bb412]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:28 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:28 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb13f5d7-01b4-42e6-a084-28ded9fe8d92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260]
Oct 16 07:42:28 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260] successful.
Oct 16 07:42:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d42d86-c999-411b-a259-aaea897c68fb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG nova.objects.instance [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'flavor' on Instance uuid 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9dba58-ed87-41c6-842e-8f2938245885]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:28 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:28 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:42:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:28 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:28 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:42:28 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f2873-f643-471b-bf8e-811ba23b1bbb]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URGJHYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-13a75679-d96e-4530-972d-b08a9c836d7e tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.991s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a35de85-4095-4a93-8d33-a4577b960b95/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23131303736346637', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131303736346637', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1576485597',display_name='tempest-TestVolumeBootPattern-server-1576485597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1576485597',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUB4evsnJY2sT1HccGkPebZAqVN/dVr0njmKk6++1K+M1J0EeXtYJ/VhykTTCYV6t+en05gMrUhPTd7ZZ42WU1pr/6VunsCqdc5GhfD3N/4gmeez4gK3GWGniO7CnDJQ==',key_name='tempest-TestVolumeBootPattern-975136939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-2lamk1lt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:42:12Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=20180aaa-89c9-42fa-ae42-ded783acb8ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:dd:22,bridge_name='br-int',has_traffic_filtering=True,id=c0d08985-d438-4228-9608-33f7c2ac6b3a,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d08985-d4') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.objects.instance [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'pci_devices' on Instance uuid 20180aaa-89c9-42fa-ae42-ded783acb8ec {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:42:29 user nova-compute[74080]:   <uuid>20180aaa-89c9-42fa-ae42-ded783acb8ec</uuid>
Oct 16 07:42:29 user nova-compute[74080]:   <name>instance-0000001f</name>
Oct 16 07:42:29 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:42:29 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:42:29 user nova-compute[74080]:   <metadata>
Oct 16 07:42:29 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:42:29 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:42:29 user nova-compute[74080]:       <nova:name>tempest-TestVolumeBootPattern-server-1576485597</nova:name>
Oct 16 07:42:29 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:42:28</nova:creationTime>
Oct 16 07:42:29 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:42:29 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:42:29 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:42:29 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:42:29 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:42:29 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:42:29 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:42:29 user nova-compute[74080]:       <nova:owner>
Oct 16 07:42:29 user nova-compute[74080]:         <nova:user uuid="33b58ae309d047548ebf29684db6037e">tempest-TestVolumeBootPattern-959199453-project-member</nova:user>
Oct 16 07:42:29 user nova-compute[74080]:         <nova:project uuid="c8b70039a31c47f39f7bf1b01b4e6e79">tempest-TestVolumeBootPattern-959199453</nova:project>
Oct 16 07:42:29 user nova-compute[74080]:       </nova:owner>
Oct 16 07:42:29 user nova-compute[74080]:       <nova:ports>
Oct 16 07:42:29 user nova-compute[74080]:         <nova:port uuid="c0d08985-d438-4228-9608-33f7c2ac6b3a">
Oct 16 07:42:29 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:42:29 user nova-compute[74080]:         </nova:port>
Oct 16 07:42:29 user nova-compute[74080]:       </nova:ports>
Oct 16 07:42:29 user nova-compute[74080]:     </nova:instance>
Oct 16 07:42:29 user nova-compute[74080]:   </metadata>
Oct 16 07:42:29 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:42:29 user nova-compute[74080]:     <system>
Oct 16 07:42:29 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:42:29 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:42:29 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:42:29 user nova-compute[74080]:       <entry name="serial">20180aaa-89c9-42fa-ae42-ded783acb8ec</entry>
Oct 16 07:42:29 user nova-compute[74080]:       <entry name="uuid">20180aaa-89c9-42fa-ae42-ded783acb8ec</entry>
Oct 16 07:42:29 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:42:29 user nova-compute[74080]:     </system>
Oct 16 07:42:29 user nova-compute[74080]:   </sysinfo>
Oct 16 07:42:29 user nova-compute[74080]:   <os>
Oct 16 07:42:29 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:42:29 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:42:29 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:42:29 user nova-compute[74080]:   </os>
Oct 16 07:42:29 user nova-compute[74080]:   <features>
Oct 16 07:42:29 user nova-compute[74080]:     <acpi/>
Oct 16 07:42:29 user nova-compute[74080]:     <apic/>
Oct 16 07:42:29 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:42:29 user nova-compute[74080]:   </features>
Oct 16 07:42:29 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:42:29 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:42:29 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:42:29 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:42:29 user nova-compute[74080]:   </clock>
Oct 16 07:42:29 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:42:29 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:42:29 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:42:29 user nova-compute[74080]:   </cpu>
Oct 16 07:42:29 user nova-compute[74080]:   <devices>
Oct 16 07:42:29 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:42:29 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:42:29 user nova-compute[74080]:       <source dev="/dev/sdb"/>
Oct 16 07:42:29 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:42:29 user nova-compute[74080]:       <serial>6abde53f-ca40-4805-89b6-7274eb9fad84</serial>
Oct 16 07:42:29 user nova-compute[74080]:     </disk>
Oct 16 07:42:29 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:42:29 user nova-compute[74080]:       <mac address="fa:16:3e:57:dd:22"/>
Oct 16 07:42:29 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:42:29 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:42:29 user nova-compute[74080]:       <target dev="tapc0d08985-d4"/>
Oct 16 07:42:29 user nova-compute[74080]:     </interface>
Oct 16 07:42:29 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:42:29 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/20180aaa-89c9-42fa-ae42-ded783acb8ec/console.log" append="off"/>
Oct 16 07:42:29 user nova-compute[74080]:     </serial>
Oct 16 07:42:29 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:42:29 user nova-compute[74080]:     <video>
Oct 16 07:42:29 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:42:29 user nova-compute[74080]:     </video>
Oct 16 07:42:29 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:42:29 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:42:29 user nova-compute[74080]:     </rng>
Oct 16 07:42:29 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:42:29 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:42:29 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:42:29 user nova-compute[74080]:     </memballoon>
Oct 16 07:42:29 user nova-compute[74080]:   </devices>
Oct 16 07:42:29 user nova-compute[74080]: </domain>
Oct 16 07:42:29 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1576485597',display_name='tempest-TestVolumeBootPattern-server-1576485597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1576485597',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUB4evsnJY2sT1HccGkPebZAqVN/dVr0njmKk6++1K+M1J0EeXtYJ/VhykTTCYV6t+en05gMrUhPTd7ZZ42WU1pr/6VunsCqdc5GhfD3N/4gmeez4gK3GWGniO7CnDJQ==',key_name='tempest-TestVolumeBootPattern-975136939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-2lamk1lt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:42:12Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=20180aaa-89c9-42fa-ae42-ded783acb8ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:dd:22,bridge_name='br-int',has_traffic_filtering=True,id=c0d08985-d438-4228-9608-33f7c2ac6b3a,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d08985-d4') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG os_vif [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:dd:22,bridge_name='br-int',has_traffic_filtering=True,id=c0d08985-d438-4228-9608-33f7c2ac6b3a,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d08985-d4') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4dcec74-b716-52b4-a1da-8ac6b8006743', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0d08985-d4, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0d08985-d4, col_values=(('qos', UUID('41fc01b2-c0bc-404a-8f61-a5d90e05d9f3')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0d08985-d4, col_values=(('external_ids', {'iface-id': 'c0d08985-d438-4228-9608-33f7c2ac6b3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:dd:22', 'vm-uuid': '20180aaa-89c9-42fa-ae42-ded783acb8ec'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:29 user nova-compute[74080]: INFO os_vif [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:dd:22,bridge_name='br-int',has_traffic_filtering=True,id=c0d08985-d438-4228-9608-33f7c2ac6b3a,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d08985-d4')
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No VIF found with MAC fa:16:3e:57:dd:22, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-b588c178-3d83-4fc2-8323-0e3b8b63d025 req-bb8966a8-c65f-4647-9d33-975bc104ab53 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b588c178-3d83-4fc2-8323-0e3b8b63d025 req-bb8966a8-c65f-4647-9d33-975bc104ab53 service nova] Acquiring lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b588c178-3d83-4fc2-8323-0e3b8b63d025 req-bb8966a8-c65f-4647-9d33-975bc104ab53 service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b588c178-3d83-4fc2-8323-0e3b8b63d025 req-bb8966a8-c65f-4647-9d33-975bc104ab53 service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-b588c178-3d83-4fc2-8323-0e3b8b63d025 req-bb8966a8-c65f-4647-9d33-975bc104ab53 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] No waiting events found dispatching network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:33 user nova-compute[74080]: WARNING nova.compute.manager [req-b588c178-3d83-4fc2-8323-0e3b8b63d025 req-bb8966a8-c65f-4647-9d33-975bc104ab53 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received unexpected event network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a for instance with vm_state building and task_state spawning.
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-eb7ef15f-9021-453f-8996-19f5291e75e7 req-95948655-ba55-4db7-b886-f7c59f4262db service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eb7ef15f-9021-453f-8996-19f5291e75e7 req-95948655-ba55-4db7-b886-f7c59f4262db service nova] Acquiring lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eb7ef15f-9021-453f-8996-19f5291e75e7 req-95948655-ba55-4db7-b886-f7c59f4262db service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eb7ef15f-9021-453f-8996-19f5291e75e7 req-95948655-ba55-4db7-b886-f7c59f4262db service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.manager [req-eb7ef15f-9021-453f-8996-19f5291e75e7 req-95948655-ba55-4db7-b886-f7c59f4262db service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] No waiting events found dispatching network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:33 user nova-compute[74080]: WARNING nova.compute.manager [req-eb7ef15f-9021-453f-8996-19f5291e75e7 req-95948655-ba55-4db7-b886-f7c59f4262db service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received unexpected event network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a for instance with vm_state building and task_state spawning.
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "bc44f5cc-26d8-4ff2-a868-432143effed3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:33 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:42:33 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7145MB free_disk=25.01642608642578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:42:33 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Instance spawned successfully.
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d78e592d-691e-4fa1-9840-8f436fa17f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 20180aaa-89c9-42fa-ae42-ded783acb8ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:42:33 user nova-compute[74080]: INFO nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 16 07:42:34 user nova-compute[74080]: INFO nova.compute.manager [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Took 22.43 seconds to build instance.
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance bc44f5cc-26d8-4ff2-a868-432143effed3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5eeda4b0-aed8-486b-9a78-4690e6abc692 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.543s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.528s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:42:34 user nova-compute[74080]: INFO nova.compute.claims [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Claim successful on node user
Oct 16 07:42:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:42:34 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:42:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.policy [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e86c6830d51c45f78230b6231ff26e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be593890c024a4bac126c56f5fa8468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:42:35 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Creating image(s)
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "/opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "/opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk 1073741824" returned: 0 in 0.055s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:35 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Successfully created port: 2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Cannot resize image /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Ensure instance console log exists: /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Successfully updated port: 2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquired lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Received event network-changed-2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Refreshing instance network info cache due to event network-changed-2259665f-79d5-4598-9d39-e450ec93e111. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] Acquiring lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:36 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Updating instance_info_cache with network_info: [{"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Releasing lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Instance network_info: |[{"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] Acquired lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.neutron [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Refreshing network info cache for port 2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Start _get_guest_xml network_info=[{"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:42:37 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:42:37 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1610432829',display_name='tempest-TestStampPattern-server-1610432829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1610432829',id=32,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm3HclZxeYbAP5crglnBUnTQN7eMThaBG71ykXZQEsaXymaDC/W4HEf1ef0XgIFZRepCi9jiVkrLYXNRaWHJaCx2nxCrB20XK08LGe33Iw28+NZHPGS84p3WPtdNdvlxQ==',key_name='tempest-TestStampPattern-419867254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0be593890c024a4bac126c56f5fa8468',ramdisk_id='',reservation_id='r-ohk5104i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-39302602',owner_user_name='tempest-TestStampPattern-39302602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:42:35Z,user_data=None,user_id='e86c6830d51c45f78230b6231ff26e2a',uuid=bc44f5cc-26d8-4ff2-a868-432143effed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converting VIF {"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:85:d1,bridge_name='br-int',has_traffic_filtering=True,id=2259665f-79d5-4598-9d39-e450ec93e111,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2259665f-79') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.objects.instance [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'pci_devices' on Instance uuid bc44f5cc-26d8-4ff2-a868-432143effed3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:42:37 user nova-compute[74080]:   <uuid>bc44f5cc-26d8-4ff2-a868-432143effed3</uuid>
Oct 16 07:42:37 user nova-compute[74080]:   <name>instance-00000020</name>
Oct 16 07:42:37 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:42:37 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:42:37 user nova-compute[74080]:   <metadata>
Oct 16 07:42:37 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:42:37 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:42:37 user nova-compute[74080]:       <nova:name>tempest-TestStampPattern-server-1610432829</nova:name>
Oct 16 07:42:37 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:42:37</nova:creationTime>
Oct 16 07:42:37 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:42:37 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:42:37 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:42:37 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:42:37 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:42:37 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:42:37 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:42:37 user nova-compute[74080]:       <nova:owner>
Oct 16 07:42:37 user nova-compute[74080]:         <nova:user uuid="e86c6830d51c45f78230b6231ff26e2a">tempest-TestStampPattern-39302602-project-member</nova:user>
Oct 16 07:42:37 user nova-compute[74080]:         <nova:project uuid="0be593890c024a4bac126c56f5fa8468">tempest-TestStampPattern-39302602</nova:project>
Oct 16 07:42:37 user nova-compute[74080]:       </nova:owner>
Oct 16 07:42:37 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:42:37 user nova-compute[74080]:       <nova:ports>
Oct 16 07:42:37 user nova-compute[74080]:         <nova:port uuid="2259665f-79d5-4598-9d39-e450ec93e111">
Oct 16 07:42:37 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:42:37 user nova-compute[74080]:         </nova:port>
Oct 16 07:42:37 user nova-compute[74080]:       </nova:ports>
Oct 16 07:42:37 user nova-compute[74080]:     </nova:instance>
Oct 16 07:42:37 user nova-compute[74080]:   </metadata>
Oct 16 07:42:37 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:42:37 user nova-compute[74080]:     <system>
Oct 16 07:42:37 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:42:37 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:42:37 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:42:37 user nova-compute[74080]:       <entry name="serial">bc44f5cc-26d8-4ff2-a868-432143effed3</entry>
Oct 16 07:42:37 user nova-compute[74080]:       <entry name="uuid">bc44f5cc-26d8-4ff2-a868-432143effed3</entry>
Oct 16 07:42:37 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:42:37 user nova-compute[74080]:     </system>
Oct 16 07:42:37 user nova-compute[74080]:   </sysinfo>
Oct 16 07:42:37 user nova-compute[74080]:   <os>
Oct 16 07:42:37 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:42:37 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:42:37 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:42:37 user nova-compute[74080]:   </os>
Oct 16 07:42:37 user nova-compute[74080]:   <features>
Oct 16 07:42:37 user nova-compute[74080]:     <acpi/>
Oct 16 07:42:37 user nova-compute[74080]:     <apic/>
Oct 16 07:42:37 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:42:37 user nova-compute[74080]:   </features>
Oct 16 07:42:37 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:42:37 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:42:37 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:42:37 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:42:37 user nova-compute[74080]:   </clock>
Oct 16 07:42:37 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:42:37 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:42:37 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:42:37 user nova-compute[74080]:   </cpu>
Oct 16 07:42:37 user nova-compute[74080]:   <devices>
Oct 16 07:42:37 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:42:37 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:42:37 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk"/>
Oct 16 07:42:37 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:42:37 user nova-compute[74080]:     </disk>
Oct 16 07:42:37 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:42:37 user nova-compute[74080]:       <mac address="fa:16:3e:13:85:d1"/>
Oct 16 07:42:37 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:42:37 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:42:37 user nova-compute[74080]:       <target dev="tap2259665f-79"/>
Oct 16 07:42:37 user nova-compute[74080]:     </interface>
Oct 16 07:42:37 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:42:37 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/console.log" append="off"/>
Oct 16 07:42:37 user nova-compute[74080]:     </serial>
Oct 16 07:42:37 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:42:37 user nova-compute[74080]:     <video>
Oct 16 07:42:37 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:42:37 user nova-compute[74080]:     </video>
Oct 16 07:42:37 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:42:37 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:42:37 user nova-compute[74080]:     </rng>
Oct 16 07:42:37 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:42:37 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:42:37 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:42:37 user nova-compute[74080]:     </memballoon>
Oct 16 07:42:37 user nova-compute[74080]:   </devices>
Oct 16 07:42:37 user nova-compute[74080]: </domain>
Oct 16 07:42:37 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:42:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1610432829',display_name='tempest-TestStampPattern-server-1610432829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1610432829',id=32,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm3HclZxeYbAP5crglnBUnTQN7eMThaBG71ykXZQEsaXymaDC/W4HEf1ef0XgIFZRepCi9jiVkrLYXNRaWHJaCx2nxCrB20XK08LGe33Iw28+NZHPGS84p3WPtdNdvlxQ==',key_name='tempest-TestStampPattern-419867254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0be593890c024a4bac126c56f5fa8468',ramdisk_id='',reservation_id='r-ohk5104i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-39302602',owner_user_name='tempest-TestStampPattern-39302602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:42:35Z,user_data=None,user_id='e86c6830d51c45f78230b6231ff26e2a',uuid=bc44f5cc-26d8-4ff2-a868-432143effed3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converting VIF {"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:85:d1,bridge_name='br-int',has_traffic_filtering=True,id=2259665f-79d5-4598-9d39-e450ec93e111,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2259665f-79') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG os_vif [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:85:d1,bridge_name='br-int',has_traffic_filtering=True,id=2259665f-79d5-4598-9d39-e450ec93e111,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2259665f-79') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '779f7614-09d5-5357-83ec-740a4d794e2f', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2259665f-79, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2259665f-79, col_values=(('qos', UUID('1effe346-88a5-43d4-8286-b54e979b8c85')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2259665f-79, col_values=(('external_ids', {'iface-id': '2259665f-79d5-4598-9d39-e450ec93e111', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:85:d1', 'vm-uuid': 'bc44f5cc-26d8-4ff2-a868-432143effed3'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:37 user nova-compute[74080]: INFO os_vif [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:85:d1,bridge_name='br-int',has_traffic_filtering=True,id=2259665f-79d5-4598-9d39-e450ec93e111,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2259665f-79')
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No VIF found with MAC fa:16:3e:13:85:d1, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.neutron [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Updated VIF entry in instance network info cache for port 2259665f-79d5-4598-9d39-e450ec93e111. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG nova.network.neutron [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Updating instance_info_cache with network_info: [{"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1675fc92-82bb-4005-89da-91b18f7322f8 req-42d5f4dc-6e29-433d-8589-e45a80feb4ac service nova] Releasing lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-changed-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG nova.compute.manager [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Refreshing instance network info cache due to event network-changed-38df3710-5b78-4ec5-963b-42f349b9c387. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] Acquiring lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] Acquired lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG nova.network.neutron [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Refreshing network info cache for port 38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.019s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG nova.objects.instance [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'flavor' on Instance uuid ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Ignoring supplied device name: /dev/vdb
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:39 user nova-compute[74080]: INFO nova.compute.manager [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Attaching volume 6e281ac5-7813-4877-90fd-b359dc439eb9 to /dev/vdb
Oct 16 07:42:39 user nova-compute[74080]: DEBUG nova.network.neutron [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Updated VIF entry in instance network info cache for port 38df3710-5b78-4ec5-963b-42f349b9c387. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG nova.network.neutron [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Updating instance_info_cache with network_info: [{"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG os_brick.utils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-dbcc456f-057c-4098-aa72-50f0f06f66c0 req-47d0659e-d3a1-4951-a057-7906743aff3b service nova] Releasing lock "refresh_cache-ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bef616-c09e-4f1d-807e-e5101a3f6640]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4409f1-392e-4cc2-a9ba-cea8b9d4faf4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe641f8-7c9d-4d81-b110-bed82deddc18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d800d0-f585-4c33-97a1-57913bbe34db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:42:39 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:42:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f531c8b-7135-4bb8-a880-d212894f0715]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG os_brick.utils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Updating existing volume attachment record: 96b7017f-afce-42fb-8376-c5627c94a932 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Received event network-vif-plugged-2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] Acquiring lock "bc44f5cc-26d8-4ff2-a868-432143effed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] No waiting events found dispatching network-vif-plugged-2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:40 user nova-compute[74080]: WARNING nova.compute.manager [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Received unexpected event network-vif-plugged-2259665f-79d5-4598-9d39-e450ec93e111 for instance with vm_state building and task_state spawning.
Oct 16 07:42:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Received event network-vif-plugged-2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] Acquiring lock "bc44f5cc-26d8-4ff2-a868-432143effed3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] No waiting events found dispatching network-vif-plugged-2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:40 user nova-compute[74080]: WARNING nova.compute.manager [req-6e06ada6-101f-4ed6-84d0-43b67c4de367 req-4f117e6c-9c5b-4fc4-8f61-a5c4027890d0 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Received unexpected event network-vif-plugged-2259665f-79d5-4598-9d39-e450ec93e111 for instance with vm_state building and task_state spawning.
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:42:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Instance spawned successfully.
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:42:41 user nova-compute[74080]: INFO nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Took 6.02 seconds to spawn the instance on the hypervisor.
Oct 16 07:42:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:42:41 user nova-compute[74080]: INFO nova.compute.manager [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Took 7.54 seconds to build instance.
Oct 16 07:42:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5b468556-dad2-4455-8cff-a605f1ae8882 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.711s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:44 user nova-compute[74080]: INFO nova.compute.manager [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Terminating instance
Oct 16 07:42:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-b472ad26-e0b2-42f7-b7fb-ec57bd3e61dd req-24642961-8092-40c9-a1b2-b447acc03c0b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-unplugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b472ad26-e0b2-42f7-b7fb-ec57bd3e61dd req-24642961-8092-40c9-a1b2-b447acc03c0b service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b472ad26-e0b2-42f7-b7fb-ec57bd3e61dd req-24642961-8092-40c9-a1b2-b447acc03c0b service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b472ad26-e0b2-42f7-b7fb-ec57bd3e61dd req-24642961-8092-40c9-a1b2-b447acc03c0b service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-b472ad26-e0b2-42f7-b7fb-ec57bd3e61dd req-24642961-8092-40c9-a1b2-b447acc03c0b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-unplugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-b472ad26-e0b2-42f7-b7fb-ec57bd3e61dd req-24642961-8092-40c9-a1b2-b447acc03c0b service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-unplugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:42:45 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Instance destroyed successfully.
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.objects.instance [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'resources' on Instance uuid d2f1f6a7-9bf5-4542-8408-d634e25bbd66 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-293706194',display_name='tempest-TestMinimumBasicScenario-server-293706194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-293706194',id=21,image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0HgaFzgT16PzViw2GUVBuCQPdZZAN2aJww3qG+wrjc0AB73ZDIFZ3GmBtwMglULbpdFjnprQLUiVvJqKWNNuIihlQ3mFyqoF9NZYtc5BfEv0ZlEub7B4odRbPJ/b/ocQ==',key_name='tempest-TestMinimumBasicScenario-871128063',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-bi7weth5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d057cc5a-de02-43b9-aa26-f17812bdf186',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:40:00Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=d2f1f6a7-9bf5-4542-8408-d634e25bbd66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "address": "fa:16:3e:71:ae:6a", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4255ae13-23", "ovs_interfaceid": "4255ae13-23f2-4c25-b194-9c4fc4ed9342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG os_vif [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4255ae13-23, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a818cd45-4fed-4b12-b5cf-090b764c43ba) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:42:45 user nova-compute[74080]: INFO os_vif [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:ae:6a,bridge_name='br-int',has_traffic_filtering=True,id=4255ae13-23f2-4c25-b194-9c4fc4ed9342,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4255ae13-23')
Oct 16 07:42:45 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Deleting instance files /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66_del
Oct 16 07:42:45 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Deletion of /opt/stack/data/nova/instances/d2f1f6a7-9bf5-4542-8408-d634e25bbd66_del complete
Oct 16 07:42:45 user nova-compute[74080]: INFO nova.compute.manager [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 16 07:42:45 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:42:45 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:42:46 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:46 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Took 0.56 seconds to deallocate network for instance.
Oct 16 07:42:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-a2bba3f1-fa2b-46ec-b2ce-bb836210292a req-b95d4d18-d1cc-472d-8c58-56df13fca82d service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-deleted-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:46 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:42:46 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:42:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:46 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Deleted allocations for instance d2f1f6a7-9bf5-4542-8408-d634e25bbd66
Oct 16 07:42:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-057ed0c7-4435-407b-8826-6b683dd03b6d tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-8dca0ba1-0328-4c6f-a0d8-668f651b1bc3 req-195c2bdf-89fa-4637-9343-a976b5e40733 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8dca0ba1-0328-4c6f-a0d8-668f651b1bc3 req-195c2bdf-89fa-4637-9343-a976b5e40733 service nova] Acquiring lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8dca0ba1-0328-4c6f-a0d8-668f651b1bc3 req-195c2bdf-89fa-4637-9343-a976b5e40733 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8dca0ba1-0328-4c6f-a0d8-668f651b1bc3 req-195c2bdf-89fa-4637-9343-a976b5e40733 service nova] Lock "d2f1f6a7-9bf5-4542-8408-d634e25bbd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-8dca0ba1-0328-4c6f-a0d8-668f651b1bc3 req-195c2bdf-89fa-4637-9343-a976b5e40733 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] No waiting events found dispatching network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:47 user nova-compute[74080]: WARNING nova.compute.manager [req-8dca0ba1-0328-4c6f-a0d8-668f651b1bc3 req-195c2bdf-89fa-4637-9343-a976b5e40733 service nova] [instance: d2f1f6a7-9bf5-4542-8408-d634e25bbd66] Received unexpected event network-vif-plugged-4255ae13-23f2-4c25-b194-9c4fc4ed9342 for instance with vm_state deleted and task_state None.
Oct 16 07:42:47 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:52 user nova-compute[74080]: INFO nova.compute.manager [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Unrescuing
Oct 16 07:42:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquired lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG nova.network.neutron [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG nova.network.neutron [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Updating instance_info_cache with network_info: [{"id": "428a165b-6148-4fe5-a539-dad7bbb9a399", "address": "fa:16:3e:f1:82:50", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap428a165b-61", "ovs_interfaceid": "428a165b-6148-4fe5-a539-dad7bbb9a399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Releasing lock "refresh_cache-5a35de85-4095-4a93-8d33-a4577b960b95" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG nova.objects.instance [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'flavor' on Instance uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:52 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-e542bd13-402d-414d-bec5-a74ae1f872b1 req-5b5fbe56-84f9-4b8f-91a8-e6a594ffd49d service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-unplugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e542bd13-402d-414d-bec5-a74ae1f872b1 req-5b5fbe56-84f9-4b8f-91a8-e6a594ffd49d service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e542bd13-402d-414d-bec5-a74ae1f872b1 req-5b5fbe56-84f9-4b8f-91a8-e6a594ffd49d service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e542bd13-402d-414d-bec5-a74ae1f872b1 req-5b5fbe56-84f9-4b8f-91a8-e6a594ffd49d service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:53 user nova-compute[74080]: DEBUG nova.compute.manager [req-e542bd13-402d-414d-bec5-a74ae1f872b1 req-5b5fbe56-84f9-4b8f-91a8-e6a594ffd49d service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-unplugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:53 user nova-compute[74080]: WARNING nova.compute.manager [req-e542bd13-402d-414d-bec5-a74ae1f872b1 req-5b5fbe56-84f9-4b8f-91a8-e6a594ffd49d service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-unplugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:42:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:53 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Instance destroyed successfully.
Oct 16 07:42:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:54 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-777f1e82-7c9a-4279-8bf3-bbb4ccaf9a27 req-2981f504-30ac-449e-b923-4283baeabef7 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-777f1e82-7c9a-4279-8bf3-bbb4ccaf9a27 req-2981f504-30ac-449e-b923-4283baeabef7 service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-777f1e82-7c9a-4279-8bf3-bbb4ccaf9a27 req-2981f504-30ac-449e-b923-4283baeabef7 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-777f1e82-7c9a-4279-8bf3-bbb4ccaf9a27 req-2981f504-30ac-449e-b923-4283baeabef7 service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-777f1e82-7c9a-4279-8bf3-bbb4ccaf9a27 req-2981f504-30ac-449e-b923-4283baeabef7 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:55 user nova-compute[74080]: WARNING nova.compute.manager [req-777f1e82-7c9a-4279-8bf3-bbb4ccaf9a27 req-2981f504-30ac-449e-b923-4283baeabef7 service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:42:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:56 user nova-compute[74080]: INFO nova.compute.manager [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Terminating instance
Oct 16 07:42:56 user nova-compute[74080]: DEBUG nova.compute.manager [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [None req-80d98d80-66c3-46d5-b4bf-4256fcc39e86 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:57 user nova-compute[74080]: WARNING nova.compute.manager [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state active and task_state None.
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] Lock "5a35de85-4095-4a93-8d33-a4577b960b95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] No waiting events found dispatching network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:57 user nova-compute[74080]: WARNING nova.compute.manager [req-c2df6694-e391-4034-8183-2fe1224a8ad0 req-632a2052-0bc0-4d14-90bf-6afed11fa9fd service nova] [instance: 5a35de85-4095-4a93-8d33-a4577b960b95] Received unexpected event network-vif-plugged-428a165b-6148-4fe5-a539-dad7bbb9a399 for instance with vm_state active and task_state None.
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-213365f1-ffa7-4163-a404-8f09194b0bb6 req-2162e005-327b-4a6f-860e-414e2c67c5e1 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-vif-unplugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-213365f1-ffa7-4163-a404-8f09194b0bb6 req-2162e005-327b-4a6f-860e-414e2c67c5e1 service nova] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-213365f1-ffa7-4163-a404-8f09194b0bb6 req-2162e005-327b-4a6f-860e-414e2c67c5e1 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-213365f1-ffa7-4163-a404-8f09194b0bb6 req-2162e005-327b-4a6f-860e-414e2c67c5e1 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-213365f1-ffa7-4163-a404-8f09194b0bb6 req-2162e005-327b-4a6f-860e-414e2c67c5e1 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] No waiting events found dispatching network-vif-unplugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-213365f1-ffa7-4163-a404-8f09194b0bb6 req-2162e005-327b-4a6f-860e-414e2c67c5e1 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-vif-unplugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:42:57 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Instance destroyed successfully.
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.objects.instance [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lazy-loading 'resources' on Instance uuid 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-557770387',display_name='tempest-AttachVolumeNegativeTest-server-557770387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-557770387',id=28,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBAlrIjQMnTXqnzcZlGuRZB6Lc+F9ebBVpVI4+Q9RwaiiTYGYW7ArXgVBEdk6EagZNOgCZMwQbq1oLjUQwAiYdel8G679LWB/wQkF4GTvsbe+3gpsCA9jflAC3+6rj/hug==',key_name='tempest-keypair-973926211',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:39:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='998dad27b18a4a15a4563815aa57cb72',ramdisk_id='',reservation_id='r-wef1007y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1751015165',owner_user_name='tempest-AttachVolumeNegativeTest-1751015165-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bbfbcc052d274a2b85276bf7c12e8233',uuid=64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converting VIF {"id": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "address": "fa:16:3e:59:e2:db", "network": {"id": "3f10d0da-f084-4dcf-91be-ec7374a99afa", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2097660974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "998dad27b18a4a15a4563815aa57cb72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c948a4-99", "ovs_interfaceid": "84c948a4-99bd-4493-acd7-c5b45d3211c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=84c948a4-99bd-4493-acd7-c5b45d3211c3,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c948a4-99') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG os_vif [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=84c948a4-99bd-4493-acd7-c5b45d3211c3,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c948a4-99') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c948a4-99, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca2a85ee-01ff-4737-8315-557ce122fac5) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:57 user nova-compute[74080]: INFO os_vif [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=84c948a4-99bd-4493-acd7-c5b45d3211c3,network=Network(3f10d0da-f084-4dcf-91be-ec7374a99afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c948a4-99')
Oct 16 07:42:57 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Deleting instance files /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c_del
Oct 16 07:42:57 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Deletion of /opt/stack/data/nova/instances/64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c_del complete
Oct 16 07:42:57 user nova-compute[74080]: INFO nova.compute.manager [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 16 07:42:57 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:42:57 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDlgrLYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:42:58 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:58 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:42:58 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[633da5a8-9987-460b-a783-e90436747677]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:42:58 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a748a2da-355d-4e26-a6fb-57dc995318c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9] added
Oct 16 07:42:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'pci_requests' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddb0fed-6f5e-434d-b662-5e03ea076a40]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'numa_topology' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0211fd-a98e-4728-80cd-eba2fa9b3f21]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:42:58 user nova-compute[74080]: INFO nova.compute.claims [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Claim successful on node user
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDlgrLYG {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDlgrLYG" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93deb882-7a1e-4aff-b227-50dd8d8b5b78]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EDlgrLYG'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[480381ae-e17b-4a48-bb3e-bbc59a65aad6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0387aa3-ec4e-4a3c-aaa4-b20de32d41bc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[444d98c4-01d3-4863-b939-c02c52b159fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260]
Oct 16 07:42:58 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260] successful.
Oct 16 07:42:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c973f1-8374-421f-bfcd-857d0838515e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6110ca-9735-48e1-a37e-9d102149d959]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:42:58 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a6b33b-6b3b-42ad-ad8a-2985bcd95a91]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDlgrLYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:58 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Took 0.68 seconds to deallocate network for instance.
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.compute.manager [req-3b27312e-671e-46a3-a0de-c194f058afff req-b83b1bd5-ae77-4da6-a754-825db1c57861 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-vif-deleted-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.129s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:58 user nova-compute[74080]: INFO nova.network.neutron [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:59 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Deleted allocations for instance 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-d8b368dd-b589-4721-8c6f-769d6d843de8 tempest-AttachVolumeNegativeTest-1751015165 tempest-AttachVolumeNegativeTest-1751015165-project-member] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-2b5688d1-557f-4fad-b5f6-31c50f2e399b req-fcb96346-7a0b-46a6-9c21-6b9315481490 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received event network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2b5688d1-557f-4fad-b5f6-31c50f2e399b req-fcb96346-7a0b-46a6-9c21-6b9315481490 service nova] Acquiring lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2b5688d1-557f-4fad-b5f6-31c50f2e399b req-fcb96346-7a0b-46a6-9c21-6b9315481490 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2b5688d1-557f-4fad-b5f6-31c50f2e399b req-fcb96346-7a0b-46a6-9c21-6b9315481490 service nova] Lock "64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.compute.manager [req-2b5688d1-557f-4fad-b5f6-31c50f2e399b req-fcb96346-7a0b-46a6-9c21-6b9315481490 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] No waiting events found dispatching network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:42:59 user nova-compute[74080]: WARNING nova.compute.manager [req-2b5688d1-557f-4fad-b5f6-31c50f2e399b req-fcb96346-7a0b-46a6-9c21-6b9315481490 service nova] [instance: 64d4b1b7-10f9-4421-9a1c-7c04bd1bff3c] Received unexpected event network-vif-plugged-84c948a4-99bd-4493-acd7-c5b45d3211c3 for instance with vm_state deleted and task_state None.
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquired lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.network.neutron [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23138653865323031', 'path': '/dev/sdc'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138653865323031', 'path': '/dev/sdc'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.objects.instance [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'flavor' on Instance uuid ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:42:59 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:42:59 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:42:59 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:42:59 user nova-compute[74080]:   <serial>6e281ac5-7813-4877-90fd-b359dc439eb9</serial>
Oct 16 07:42:59 user nova-compute[74080]: </disk>
Oct 16 07:42:59 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.network.neutron [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Releasing lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:42:59 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Creating image(s)
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG nova.objects.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Object Instance<d3e5e8b9-5b6f-446a-aabe-2944817a3756> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "cedd36be2a91a3dc81f46040ad87d25e5e342487" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:42:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "cedd36be2a91a3dc81f46040ad87d25e5e342487" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.compute.manager [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.compute.manager [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing instance network info cache due to event network-changed-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] Acquiring lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] Acquired lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.network.neutron [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Refreshing network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] No VIF found with MAC fa:16:3e:38:64:ae, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.virt.images [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] 3f4752ca-633a-4f2e-a292-b035d964b8ba was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:43:00 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.part /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-88d28643-3aff-4be4-94b8-8aed0650326d tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.802s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.part /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.converted" returned: 0 in 0.303s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "cedd36be2a91a3dc81f46040ad87d25e5e342487" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.712s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487 --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "cedd36be2a91a3dc81f46040ad87d25e5e342487" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "cedd36be2a91a3dc81f46040ad87d25e5e342487" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487 --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487,backing_fmt=raw /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG nova.network.neutron [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updated VIF entry in instance network info cache for port dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG nova.network.neutron [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487,backing_fmt=raw /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk 1073741824" returned: 0 in 0.073s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "cedd36be2a91a3dc81f46040ad87d25e5e342487" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:01 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2a7ad9aa-7e88-4cad-9903-fb6b84aeaf7f req-c5a8895d-14d7-4d0b-86fd-750421107b97 service nova] Releasing lock "refresh_cache-d3e5e8b9-5b6f-446a-aabe-2944817a3756" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cedd36be2a91a3dc81f46040ad87d25e5e342487 --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'migration_context' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG nova.objects.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Object Instance<d3e5e8b9-5b6f-446a-aabe-2944817a3756> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:43:02 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Rebasing disk image.
Oct 16 07:43:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca -F raw /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca -F raw /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk" returned: 0 in 2.343s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Ensure instance console log exists: /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Start _get_guest_xml network_info=[{"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='82e1706d29a07045dd3f90a634426969',container_format='bare',created_at=2023-10-16T07:40:34Z,direct_url=<?>,disk_format='qcow2',id=3f4752ca-633a-4f2e-a292-b035d964b8ba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1117384875-shelved',owner='cb49371c30764797a229c88006622241',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T07:40:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '1c9a15e4-5be7-4a8c-ba08-4fff608b604b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gofsSBLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'd3e5e8b9-5b6f-446a-aabe-2944817a3756', 'attached_at': '', 'detached_at': '', 'volume_id': '6b19066e-062f-425b-9ab5-a7de1989b9c7', 'serial': '6b19066e-062f-425b-9ab5-a7de1989b9c7'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:43:04 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:43:04 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='82e1706d29a07045dd3f90a634426969',container_format='bare',created_at=2023-10-16T07:40:34Z,direct_url=<?>,disk_format='qcow2',id=3f4752ca-633a-4f2e-a292-b035d964b8ba,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1117384875-shelved',owner='cb49371c30764797a229c88006622241',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T07:40:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.objects.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Object Instance<d3e5e8b9-5b6f-446a-aabe-2944817a3756> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gofsSBLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:43:04 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:43:04 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:43:04 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260" returned: 21 in 0.042s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4331c545-d782-4a3d-aa02-9ad47773dbba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:43:04 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf7854-8448-4e4c-b3c5-491051cc1cae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7] added
Oct 16 07:43:04 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb07480-7d4a-4cf3-8353-b9fe3f7a6719]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed97c129-ace1-4a32-b32e-fe9a85805fa0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gofsSBLN {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gofsSBLN" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f484567-63a8-48f8-84c6-9706ae9f3086]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gofsSBLN'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f598a208-8042-4139-a5ec-b0aacff0c8d5]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcff20-2df9-4877-ba13-9794b11d7cd9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebca9a3-7355-4a5d-93f8-b2c113923f3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260]
Oct 16 07:43:05 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260] successful.
Oct 16 07:43:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[845482be-0654-4cf5-832b-35419ec37872]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8bb83-b402-45ba-a6a5-333f76378634]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:43:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a1118-b119-477b-9d95-0d822a056cc5]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:43:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gofsSBLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23732373862373631', 'path': '/dev/sde'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732373862373631', 'path': '/dev/sde'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1117384875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1117384875',id=27,image_ref='3f4752ca-633a-4f2e-a292-b035d964b8ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1371470985',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:38:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-nvxk32j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member',shelved_at='2023-10-16T07:40:39.030227',shelved_host='user',shelved_image_id='3f4752ca-633a-4f2e-a292-b035d964b8ba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=d3e5e8b9-5b6f-446a-aabe-2944817a3756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'pci_devices' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.objects.base [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Object Instance<d3e5e8b9-5b6f-446a-aabe-2944817a3756> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:43:06 user nova-compute[74080]:   <uuid>d3e5e8b9-5b6f-446a-aabe-2944817a3756</uuid>
Oct 16 07:43:06 user nova-compute[74080]:   <name>instance-0000001b</name>
Oct 16 07:43:06 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:43:06 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:43:06 user nova-compute[74080]:   <metadata>
Oct 16 07:43:06 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:43:06 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:43:06 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1117384875</nova:name>
Oct 16 07:43:06 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:43:04</nova:creationTime>
Oct 16 07:43:06 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:43:06 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:43:06 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:43:06 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:43:06 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:43:06 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:43:06 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:43:06 user nova-compute[74080]:       <nova:owner>
Oct 16 07:43:06 user nova-compute[74080]:         <nova:user uuid="db721d9235c64087bf54998e468b7f3e">tempest-AttachVolumeShelveTestJSON-2100146647-project-member</nova:user>
Oct 16 07:43:06 user nova-compute[74080]:         <nova:project uuid="cb49371c30764797a229c88006622241">tempest-AttachVolumeShelveTestJSON-2100146647</nova:project>
Oct 16 07:43:06 user nova-compute[74080]:       </nova:owner>
Oct 16 07:43:06 user nova-compute[74080]:       <nova:root type="image" uuid="3f4752ca-633a-4f2e-a292-b035d964b8ba"/>
Oct 16 07:43:06 user nova-compute[74080]:       <nova:ports>
Oct 16 07:43:06 user nova-compute[74080]:         <nova:port uuid="dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3">
Oct 16 07:43:06 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 07:43:06 user nova-compute[74080]:         </nova:port>
Oct 16 07:43:06 user nova-compute[74080]:       </nova:ports>
Oct 16 07:43:06 user nova-compute[74080]:     </nova:instance>
Oct 16 07:43:06 user nova-compute[74080]:   </metadata>
Oct 16 07:43:06 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:43:06 user nova-compute[74080]:     <system>
Oct 16 07:43:06 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:43:06 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:43:06 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:43:06 user nova-compute[74080]:       <entry name="serial">d3e5e8b9-5b6f-446a-aabe-2944817a3756</entry>
Oct 16 07:43:06 user nova-compute[74080]:       <entry name="uuid">d3e5e8b9-5b6f-446a-aabe-2944817a3756</entry>
Oct 16 07:43:06 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:43:06 user nova-compute[74080]:     </system>
Oct 16 07:43:06 user nova-compute[74080]:   </sysinfo>
Oct 16 07:43:06 user nova-compute[74080]:   <os>
Oct 16 07:43:06 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:43:06 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:43:06 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:43:06 user nova-compute[74080]:   </os>
Oct 16 07:43:06 user nova-compute[74080]:   <features>
Oct 16 07:43:06 user nova-compute[74080]:     <acpi/>
Oct 16 07:43:06 user nova-compute[74080]:     <apic/>
Oct 16 07:43:06 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:43:06 user nova-compute[74080]:   </features>
Oct 16 07:43:06 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:43:06 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:43:06 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:43:06 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:43:06 user nova-compute[74080]:   </clock>
Oct 16 07:43:06 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:43:06 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:43:06 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:43:06 user nova-compute[74080]:   </cpu>
Oct 16 07:43:06 user nova-compute[74080]:   <devices>
Oct 16 07:43:06 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:43:06 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:43:06 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk"/>
Oct 16 07:43:06 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:43:06 user nova-compute[74080]:     </disk>
Oct 16 07:43:06 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:43:06 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:43:06 user nova-compute[74080]:       <source dev="/dev/sde"/>
Oct 16 07:43:06 user nova-compute[74080]:       <target dev="vdc" bus="virtio"/>
Oct 16 07:43:06 user nova-compute[74080]:       <serial>6b19066e-062f-425b-9ab5-a7de1989b9c7</serial>
Oct 16 07:43:06 user nova-compute[74080]:     </disk>
Oct 16 07:43:06 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:43:06 user nova-compute[74080]:       <mac address="fa:16:3e:bb:fd:24"/>
Oct 16 07:43:06 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:43:06 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:43:06 user nova-compute[74080]:       <target dev="tapdab1e9e8-5b"/>
Oct 16 07:43:06 user nova-compute[74080]:     </interface>
Oct 16 07:43:06 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:43:06 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/console.log" append="off"/>
Oct 16 07:43:06 user nova-compute[74080]:     </serial>
Oct 16 07:43:06 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:43:06 user nova-compute[74080]:     <video>
Oct 16 07:43:06 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:43:06 user nova-compute[74080]:     </video>
Oct 16 07:43:06 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:43:06 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:43:06 user nova-compute[74080]:     </rng>
Oct 16 07:43:06 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:43:06 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:43:06 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:43:06 user nova-compute[74080]:     </memballoon>
Oct 16 07:43:06 user nova-compute[74080]:   </devices>
Oct 16 07:43:06 user nova-compute[74080]: </domain>
Oct 16 07:43:06 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1117384875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1117384875',id=27,image_ref='3f4752ca-633a-4f2e-a292-b035d964b8ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1371470985',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:38:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-nvxk32j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member',shelved_at='2023-10-16T07:40:39.030227',shelved_host='user',shelved_image_id='3f4752ca-633a-4f2e-a292-b035d964b8ba'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:42:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=d3e5e8b9-5b6f-446a-aabe-2944817a3756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG os_vif [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39eb163f-8eb5-5d05-ab89-4e75c1e2b44f', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdab1e9e8-5b, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdab1e9e8-5b, col_values=(('qos', UUID('a2823bd1-0cc4-4ed7-a71a-2448854ed840')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdab1e9e8-5b, col_values=(('external_ids', {'iface-id': 'dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:fd:24', 'vm-uuid': 'd3e5e8b9-5b6f-446a-aabe-2944817a3756'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:06 user nova-compute[74080]: INFO os_vif [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b')
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:43:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] No VIF found with MAC fa:16:3e:bb:fd:24, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:43:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-67662839-dfa4-42a3-88b2-428c22015169 req-4928efaa-af40-40b4-b7fd-fa9295ae3170 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-67662839-dfa4-42a3-88b2-428c22015169 req-4928efaa-af40-40b4-b7fd-fa9295ae3170 service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-67662839-dfa4-42a3-88b2-428c22015169 req-4928efaa-af40-40b4-b7fd-fa9295ae3170 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-67662839-dfa4-42a3-88b2-428c22015169 req-4928efaa-af40-40b4-b7fd-fa9295ae3170 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-67662839-dfa4-42a3-88b2-428c22015169 req-4928efaa-af40-40b4-b7fd-fa9295ae3170 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:08 user nova-compute[74080]: WARNING nova.compute.manager [req-67662839-dfa4-42a3-88b2-428c22015169 req-4928efaa-af40-40b4-b7fd-fa9295ae3170 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received unexpected event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 07:43:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:43:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:43:10 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance spawned successfully.
Oct 16 07:43:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:43:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-9a4302fe-842e-4e5a-98bf-2bffa7350641 req-83293389-5a5e-43ab-93a1-3bb15e595850 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9a4302fe-842e-4e5a-98bf-2bffa7350641 req-83293389-5a5e-43ab-93a1-3bb15e595850 service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9a4302fe-842e-4e5a-98bf-2bffa7350641 req-83293389-5a5e-43ab-93a1-3bb15e595850 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9a4302fe-842e-4e5a-98bf-2bffa7350641 req-83293389-5a5e-43ab-93a1-3bb15e595850 service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-9a4302fe-842e-4e5a-98bf-2bffa7350641 req-83293389-5a5e-43ab-93a1-3bb15e595850 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:10 user nova-compute[74080]: WARNING nova.compute.manager [req-9a4302fe-842e-4e5a-98bf-2bffa7350641 req-83293389-5a5e-43ab-93a1-3bb15e595850 service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received unexpected event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 07:43:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f277358f-c22f-42a0-a469-7fbb6a1f3c80 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 44.327s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:15 user nova-compute[74080]: INFO nova.compute.manager [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Terminating instance
Oct 16 07:43:15 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-7b7bad0b-f6b8-4fd7-9a59-0c170697c39f req-08984c25-0386-44b4-a481-165b0af798bf service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7b7bad0b-f6b8-4fd7-9a59-0c170697c39f req-08984c25-0386-44b4-a481-165b0af798bf service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7b7bad0b-f6b8-4fd7-9a59-0c170697c39f req-08984c25-0386-44b4-a481-165b0af798bf service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7b7bad0b-f6b8-4fd7-9a59-0c170697c39f req-08984c25-0386-44b4-a481-165b0af798bf service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-7b7bad0b-f6b8-4fd7-9a59-0c170697c39f req-08984c25-0386-44b4-a481-165b0af798bf service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:15 user nova-compute[74080]: DEBUG nova.compute.manager [req-7b7bad0b-f6b8-4fd7-9a59-0c170697c39f req-08984c25-0386-44b4-a481-165b0af798bf service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-unplugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:43:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Instance destroyed successfully.
Oct 16 07:43:16 user nova-compute[74080]: DEBUG nova.objects.instance [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'resources' on Instance uuid a889e1ab-9c69-4dbb-8a67-79d24bd67678 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:33:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-878526387',display_name='tempest-AttachVolumeTestJSON-server-878526387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-878526387',id=13,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFS8y5oPsO0XYFRK8I8ad1Eov2VtxsmN6afXFzbUwXL/pmi89igx5IDevO/HmxrAQJXpdLqu3Yn+RRCm2sbOj+SElhxCEf4IN9x9OZQz3YoUDQVvUx4j8YZamTd9Ut+BHw==',key_name='tempest-keypair-174531481',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-e2ex5ckl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=a889e1ab-9c69-4dbb-8a67-79d24bd67678,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "address": "fa:16:3e:e0:3e:55", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fb90376-ac", "ovs_interfaceid": "8fb90376-ac0a-4d74-8a23-29564ea728a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG os_vif [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fb90376-ac, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a2cd6f8-51dc-4d4b-8c6b-0f9af702c46c) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:16 user nova-compute[74080]: INFO os_vif [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:3e:55,bridge_name='br-int',has_traffic_filtering=True,id=8fb90376-ac0a-4d74-8a23-29564ea728a4,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fb90376-ac')
Oct 16 07:43:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Deleting instance files /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678_del
Oct 16 07:43:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Deletion of /opt/stack/data/nova/instances/a889e1ab-9c69-4dbb-8a67-79d24bd67678_del complete
Oct 16 07:43:16 user nova-compute[74080]: INFO nova.compute.manager [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 16 07:43:16 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:43:16 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-51430f44-d7ce-460e-a644-08dbd705c3ee req-ff30454b-e124-42d6-80e1-615ef9d519f4 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-deleted-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:17 user nova-compute[74080]: INFO nova.compute.manager [req-51430f44-d7ce-460e-a644-08dbd705c3ee req-ff30454b-e124-42d6-80e1-615ef9d519f4 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Neutron deleted interface 8fb90376-ac0a-4d74-8a23-29564ea728a4; detaching it from the instance and deleting it from the info cache
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.network.neutron [req-51430f44-d7ce-460e-a644-08dbd705c3ee req-ff30454b-e124-42d6-80e1-615ef9d519f4 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:43:17 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Took 0.82 seconds to deallocate network for instance.
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-51430f44-d7ce-460e-a644-08dbd705c3ee req-ff30454b-e124-42d6-80e1-615ef9d519f4 service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Detach interface failed, port_id=8fb90376-ac0a-4d74-8a23-29564ea728a4, reason: Instance a889e1ab-9c69-4dbb-8a67-79d24bd67678 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:17 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Deleted allocations for instance a889e1ab-9c69-4dbb-8a67-79d24bd67678
Oct 16 07:43:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c517b951-b9f8-4461-b445-c717658f01a8 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-5932cd90-6ca8-4141-8c6f-8ee96fc4c51b req-30e28de4-9781-49a0-b275-26ce34f3f90a service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5932cd90-6ca8-4141-8c6f-8ee96fc4c51b req-30e28de4-9781-49a0-b275-26ce34f3f90a service nova] Acquiring lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5932cd90-6ca8-4141-8c6f-8ee96fc4c51b req-30e28de4-9781-49a0-b275-26ce34f3f90a service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5932cd90-6ca8-4141-8c6f-8ee96fc4c51b req-30e28de4-9781-49a0-b275-26ce34f3f90a service nova] Lock "a889e1ab-9c69-4dbb-8a67-79d24bd67678-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-5932cd90-6ca8-4141-8c6f-8ee96fc4c51b req-30e28de4-9781-49a0-b275-26ce34f3f90a service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] No waiting events found dispatching network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:17 user nova-compute[74080]: WARNING nova.compute.manager [req-5932cd90-6ca8-4141-8c6f-8ee96fc4c51b req-30e28de4-9781-49a0-b275-26ce34f3f90a service nova] [instance: a889e1ab-9c69-4dbb-8a67-79d24bd67678] Received unexpected event network-vif-plugged-8fb90376-ac0a-4d74-8a23-29564ea728a4 for instance with vm_state deleted and task_state None.
Oct 16 07:43:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updating instance_info_cache with network_info: [{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:43:24 user nova-compute[74080]: INFO nova.compute.manager [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Unrescuing
Oct 16 07:43:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:43:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquired lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:43:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:43:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updating instance_info_cache with network_info: [{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:43:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Releasing lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:43:24 user nova-compute[74080]: DEBUG nova.objects.instance [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'flavor' on Instance uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:43:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-8cbdbd46-f9f6-411e-afad-d8c1b096e682 req-e4005117-246e-4e3f-9dea-cec5943525df service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-unplugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8cbdbd46-f9f6-411e-afad-d8c1b096e682 req-e4005117-246e-4e3f-9dea-cec5943525df service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8cbdbd46-f9f6-411e-afad-d8c1b096e682 req-e4005117-246e-4e3f-9dea-cec5943525df service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8cbdbd46-f9f6-411e-afad-d8c1b096e682 req-e4005117-246e-4e3f-9dea-cec5943525df service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-8cbdbd46-f9f6-411e-afad-d8c1b096e682 req-e4005117-246e-4e3f-9dea-cec5943525df service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-unplugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:25 user nova-compute[74080]: WARNING nova.compute.manager [req-8cbdbd46-f9f6-411e-afad-d8c1b096e682 req-e4005117-246e-4e3f-9dea-cec5943525df service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-unplugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:43:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:25 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Instance destroyed successfully.
Oct 16 07:43:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:27 user nova-compute[74080]: WARNING nova.compute.manager [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:43:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:27 user nova-compute[74080]: WARNING nova.compute.manager [req-12c4e496-9f95-40c6-8ddb-c9b2a56ef730 req-09122479-be2b-431a-8e31-7b3fc9371ed0 service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:43:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:28 user nova-compute[74080]: DEBUG nova.compute.manager [None req-1ab41ba0-d2de-48fa-be4f-57b78750a216 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-fd40dad7-d8c0-4180-ab3c-4a1aa6236d9b req-517d37c2-ff13-4236-9dc7-3cfb094ef45c service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fd40dad7-d8c0-4180-ab3c-4a1aa6236d9b req-517d37c2-ff13-4236-9dc7-3cfb094ef45c service nova] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fd40dad7-d8c0-4180-ab3c-4a1aa6236d9b req-517d37c2-ff13-4236-9dc7-3cfb094ef45c service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fd40dad7-d8c0-4180-ab3c-4a1aa6236d9b req-517d37c2-ff13-4236-9dc7-3cfb094ef45c service nova] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-fd40dad7-d8c0-4180-ab3c-4a1aa6236d9b req-517d37c2-ff13-4236-9dc7-3cfb094ef45c service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] No waiting events found dispatching network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:29 user nova-compute[74080]: WARNING nova.compute.manager [req-fd40dad7-d8c0-4180-ab3c-4a1aa6236d9b req-517d37c2-ff13-4236-9dc7-3cfb094ef45c service nova] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Received unexpected event network-vif-plugged-0775ad16-cbd1-4e55-ac5e-669f19cd8f73 for instance with vm_state active and task_state None.
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:43:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:33 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:43:33 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7366MB free_disk=25.035812377929688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d78e592d-691e-4fa1-9840-8f436fa17f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 20180aaa-89c9-42fa-ae42-ded783acb8ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance bc44f5cc-26d8-4ff2-a868-432143effed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:43:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:43:34 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:43:34 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:43:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:43:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:36 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:38 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:43:39 user nova-compute[74080]: INFO nova.compute.claims [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Claim successful on node user
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:43:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:43:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Creating image(s)
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "/opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "/opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "/opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "0757c3d9c7dbabb802fc0fd2d97d66d553d37c07" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "0757c3d9c7dbabb802fc0fd2d97d66d553d37c07" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:39 user nova-compute[74080]: DEBUG nova.policy [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f95746283bb04c0c98d762068eaa5a24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c9d95219a244140a28a733edb91013b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.part --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG nova.virt.images [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] 0c8a75d9-bdeb-4f4f-983b-3c4a159090fa was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.part /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Successfully created port: 6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.part /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.converted" returned: 0 in 0.243s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "0757c3d9c7dbabb802fc0fd2d97d66d553d37c07" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.996s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Successfully updated port: 6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07 --force-share --output=json" returned: 0 in 0.265s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "0757c3d9c7dbabb802fc0fd2d97d66d553d37c07" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "0757c3d9c7dbabb802fc0fd2d97d66d553d37c07" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquired lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.neutron [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing instance network info cache due to event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] Acquiring lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.neutron [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07 --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07,backing_fmt=raw /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07,backing_fmt=raw /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk 1073741824" returned: 0 in 0.057s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "0757c3d9c7dbabb802fc0fd2d97d66d553d37c07" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.neutron [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating instance_info_cache with network_info: [{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0757c3d9c7dbabb802fc0fd2d97d66d553d37c07 --force-share --output=json" returned: 0 in 0.202s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Releasing lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Instance network_info: |[{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] Acquired lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.neutron [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Cannot resize image /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Ensure instance console log exists: /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Start _get_guest_xml network_info=[{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:43:36Z,direct_url=<?>,disk_format='qcow2',id=0c8a75d9-bdeb-4f4f-983b-3c4a159090fa,min_disk=0,min_ram=0,name='tempest-scenario-img--1418243089',owner='3c9d95219a244140a28a733edb91013b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:43:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': '0c8a75d9-bdeb-4f4f-983b-3c4a159090fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:43:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:43:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:43:36Z,direct_url=<?>,disk_format='qcow2',id=0c8a75d9-bdeb-4f4f-983b-3c4a159090fa,min_disk=0,min_ram=0,name='tempest-scenario-img--1418243089',owner='3c9d95219a244140a28a733edb91013b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:43:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-900461746',display_name='tempest-TestMinimumBasicScenario-server-900461746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-900461746',id=33,image_ref='0c8a75d9-bdeb-4f4f-983b-3c4a159090fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3vgdlikuFAtv77OWoAuA94Hg3ZcXENZ1DgWAptJTgMZ3NJS1VP6qzoCWkZt77pbAb0FhqcRi3I8zOuMWLpT48ovnbdjb+URKC/K8s9OpJQiVQAeVdbjjaCf+zEtmMw9A==',key_name='tempest-TestMinimumBasicScenario-463303761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-tn8ujsv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8a75d9-bdeb-4f4f-983b-3c4a159090fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:43:40Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=816158fd-6a77-4d53-9cdb-09707887bafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:37:6e,bridge_name='br-int',has_traffic_filtering=True,id=6508e90b-0fb8-4d94-9a47-71a6217e8cfb,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6508e90b-0f') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'pci_devices' on Instance uuid 816158fd-6a77-4d53-9cdb-09707887bafe {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:43:41 user nova-compute[74080]:   <uuid>816158fd-6a77-4d53-9cdb-09707887bafe</uuid>
Oct 16 07:43:41 user nova-compute[74080]:   <name>instance-00000021</name>
Oct 16 07:43:41 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:43:41 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:43:41 user nova-compute[74080]:   <metadata>
Oct 16 07:43:41 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:43:41 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:43:41 user nova-compute[74080]:       <nova:name>tempest-TestMinimumBasicScenario-server-900461746</nova:name>
Oct 16 07:43:41 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:43:41</nova:creationTime>
Oct 16 07:43:41 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:43:41 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:43:41 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:43:41 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:43:41 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:43:41 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:43:41 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:43:41 user nova-compute[74080]:       <nova:owner>
Oct 16 07:43:41 user nova-compute[74080]:         <nova:user uuid="f95746283bb04c0c98d762068eaa5a24">tempest-TestMinimumBasicScenario-1785188875-project-member</nova:user>
Oct 16 07:43:41 user nova-compute[74080]:         <nova:project uuid="3c9d95219a244140a28a733edb91013b">tempest-TestMinimumBasicScenario-1785188875</nova:project>
Oct 16 07:43:41 user nova-compute[74080]:       </nova:owner>
Oct 16 07:43:41 user nova-compute[74080]:       <nova:root type="image" uuid="0c8a75d9-bdeb-4f4f-983b-3c4a159090fa"/>
Oct 16 07:43:41 user nova-compute[74080]:       <nova:ports>
Oct 16 07:43:41 user nova-compute[74080]:         <nova:port uuid="6508e90b-0fb8-4d94-9a47-71a6217e8cfb">
Oct 16 07:43:41 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 07:43:41 user nova-compute[74080]:         </nova:port>
Oct 16 07:43:41 user nova-compute[74080]:       </nova:ports>
Oct 16 07:43:41 user nova-compute[74080]:     </nova:instance>
Oct 16 07:43:41 user nova-compute[74080]:   </metadata>
Oct 16 07:43:41 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:43:41 user nova-compute[74080]:     <system>
Oct 16 07:43:41 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:43:41 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:43:41 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:43:41 user nova-compute[74080]:       <entry name="serial">816158fd-6a77-4d53-9cdb-09707887bafe</entry>
Oct 16 07:43:41 user nova-compute[74080]:       <entry name="uuid">816158fd-6a77-4d53-9cdb-09707887bafe</entry>
Oct 16 07:43:41 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:43:41 user nova-compute[74080]:     </system>
Oct 16 07:43:41 user nova-compute[74080]:   </sysinfo>
Oct 16 07:43:41 user nova-compute[74080]:   <os>
Oct 16 07:43:41 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:43:41 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:43:41 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:43:41 user nova-compute[74080]:   </os>
Oct 16 07:43:41 user nova-compute[74080]:   <features>
Oct 16 07:43:41 user nova-compute[74080]:     <acpi/>
Oct 16 07:43:41 user nova-compute[74080]:     <apic/>
Oct 16 07:43:41 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:43:41 user nova-compute[74080]:   </features>
Oct 16 07:43:41 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:43:41 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:43:41 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:43:41 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:43:41 user nova-compute[74080]:   </clock>
Oct 16 07:43:41 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:43:41 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:43:41 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:43:41 user nova-compute[74080]:   </cpu>
Oct 16 07:43:41 user nova-compute[74080]:   <devices>
Oct 16 07:43:41 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:43:41 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:43:41 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk"/>
Oct 16 07:43:41 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:43:41 user nova-compute[74080]:     </disk>
Oct 16 07:43:41 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:43:41 user nova-compute[74080]:       <mac address="fa:16:3e:eb:37:6e"/>
Oct 16 07:43:41 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:43:41 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:43:41 user nova-compute[74080]:       <target dev="tap6508e90b-0f"/>
Oct 16 07:43:41 user nova-compute[74080]:     </interface>
Oct 16 07:43:41 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:43:41 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/console.log" append="off"/>
Oct 16 07:43:41 user nova-compute[74080]:     </serial>
Oct 16 07:43:41 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:43:41 user nova-compute[74080]:     <video>
Oct 16 07:43:41 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:43:41 user nova-compute[74080]:     </video>
Oct 16 07:43:41 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:43:41 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:43:41 user nova-compute[74080]:     </rng>
Oct 16 07:43:41 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:43:41 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:43:41 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:43:41 user nova-compute[74080]:     </memballoon>
Oct 16 07:43:41 user nova-compute[74080]:   </devices>
Oct 16 07:43:41 user nova-compute[74080]: </domain>
Oct 16 07:43:41 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-900461746',display_name='tempest-TestMinimumBasicScenario-server-900461746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-900461746',id=33,image_ref='0c8a75d9-bdeb-4f4f-983b-3c4a159090fa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3vgdlikuFAtv77OWoAuA94Hg3ZcXENZ1DgWAptJTgMZ3NJS1VP6qzoCWkZt77pbAb0FhqcRi3I8zOuMWLpT48ovnbdjb+URKC/K8s9OpJQiVQAeVdbjjaCf+zEtmMw9A==',key_name='tempest-TestMinimumBasicScenario-463303761',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c9d95219a244140a28a733edb91013b',ramdisk_id='',reservation_id='r-tn8ujsv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='0c8a75d9-bdeb-4f4f-983b-3c4a159090fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1785188875',owner_user_name='tempest-TestMinimumBasicScenario-1785188875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:43:40Z,user_data=None,user_id='f95746283bb04c0c98d762068eaa5a24',uuid=816158fd-6a77-4d53-9cdb-09707887bafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converting VIF {"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:37:6e,bridge_name='br-int',has_traffic_filtering=True,id=6508e90b-0fb8-4d94-9a47-71a6217e8cfb,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6508e90b-0f') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG os_vif [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:37:6e,bridge_name='br-int',has_traffic_filtering=True,id=6508e90b-0fb8-4d94-9a47-71a6217e8cfb,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6508e90b-0f') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8918902-37c0-55f7-bd8d-5cc338e62446', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6508e90b-0f, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6508e90b-0f, col_values=(('qos', UUID('acc05ce6-626b-4601-bd84-710876224918')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6508e90b-0f, col_values=(('external_ids', {'iface-id': '6508e90b-0fb8-4d94-9a47-71a6217e8cfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:37:6e', 'vm-uuid': '816158fd-6a77-4d53-9cdb-09707887bafe'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:41 user nova-compute[74080]: INFO os_vif [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:37:6e,bridge_name='br-int',has_traffic_filtering=True,id=6508e90b-0fb8-4d94-9a47-71a6217e8cfb,network=Network(c1170523-f6ce-4940-8eac-796de898d7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6508e90b-0f')
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No VIF found with MAC fa:16:3e:eb:37:6e, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.neutron [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updated VIF entry in instance network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG nova.network.neutron [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating instance_info_cache with network_info: [{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:43:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-90c8bc31-027e-44b1-8470-dcf99551e847 req-c533371a-bc89-4e9b-89b2-a2fc889120e4 service nova] Releasing lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:43:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-abdff780-ae8d-475b-a00f-30b8f3f411b4 req-b6d9e4e5-84f5-4f7c-bf3d-ffc9892913c8 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-abdff780-ae8d-475b-a00f-30b8f3f411b4 req-b6d9e4e5-84f5-4f7c-bf3d-ffc9892913c8 service nova] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-abdff780-ae8d-475b-a00f-30b8f3f411b4 req-b6d9e4e5-84f5-4f7c-bf3d-ffc9892913c8 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-abdff780-ae8d-475b-a00f-30b8f3f411b4 req-b6d9e4e5-84f5-4f7c-bf3d-ffc9892913c8 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG nova.compute.manager [req-abdff780-ae8d-475b-a00f-30b8f3f411b4 req-b6d9e4e5-84f5-4f7c-bf3d-ffc9892913c8 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] No waiting events found dispatching network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:43 user nova-compute[74080]: WARNING nova.compute.manager [req-abdff780-ae8d-475b-a00f-30b8f3f411b4 req-b6d9e4e5-84f5-4f7c-bf3d-ffc9892913c8 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received unexpected event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb for instance with vm_state building and task_state spawning.
Oct 16 07:43:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:43:45 user nova-compute[74080]: INFO nova.compute.manager [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Detaching volume 6e281ac5-7813-4877-90fd-b359dc439eb9
Oct 16 07:43:45 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Instance spawned successfully.
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:43:45 user nova-compute[74080]: INFO nova.virt.block_device [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Attempting to driver detach volume 6e281ac5-7813-4877-90fd-b359dc439eb9 from mountpoint /dev/vdb
Oct 16 07:43:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Attempting to detach device vdb from instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:43:45 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:43:45 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:43:45 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:43:45 user nova-compute[74080]:   <serial>6e281ac5-7813-4877-90fd-b359dc439eb9</serial>
Oct 16 07:43:45 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:43:45 user nova-compute[74080]: </disk>
Oct 16 07:43:45 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:43:45 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully detached device vdb from instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 from the persistent domain config.
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:43:45 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:43:45 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:43:45 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:43:45 user nova-compute[74080]:   <serial>6e281ac5-7813-4877-90fd-b359dc439eb9</serial>
Oct 16 07:43:45 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:43:45 user nova-compute[74080]: </disk>
Oct 16 07:43:45 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-23090fd0-7a98-4ec3-8795-bce62c7cffd9 req-5a0c66ac-b57c-40af-a9d5-0393f5915c52 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-23090fd0-7a98-4ec3-8795-bce62c7cffd9 req-5a0c66ac-b57c-40af-a9d5-0393f5915c52 service nova] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-23090fd0-7a98-4ec3-8795-bce62c7cffd9 req-5a0c66ac-b57c-40af-a9d5-0393f5915c52 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-23090fd0-7a98-4ec3-8795-bce62c7cffd9 req-5a0c66ac-b57c-40af-a9d5-0393f5915c52 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-23090fd0-7a98-4ec3-8795-bce62c7cffd9 req-5a0c66ac-b57c-40af-a9d5-0393f5915c52 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] No waiting events found dispatching network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:43:45 user nova-compute[74080]: WARNING nova.compute.manager [req-23090fd0-7a98-4ec3-8795-bce62c7cffd9 req-5a0c66ac-b57c-40af-a9d5-0393f5915c52 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received unexpected event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb for instance with vm_state building and task_state spawning.
Oct 16 07:43:45 user nova-compute[74080]: INFO nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Took 5.70 seconds to spawn the instance on the hypervisor.
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:43:45 user nova-compute[74080]: INFO nova.compute.manager [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Took 6.51 seconds to build instance.
Oct 16 07:43:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-019ff43a-132d-4a0d-a2b1-d0fe08eca09c tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.708s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:43:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:51 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:54 user nova-compute[74080]: INFO nova.compute.manager [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Detaching volume 6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:43:54 user nova-compute[74080]: INFO nova.virt.block_device [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Attempting to driver detach volume 6c3a1050-fb68-46fe-b2e0-d6d6eb03938d from mountpoint /dev/vdb
Oct 16 07:43:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Attempting to detach device vdb from instance d78e592d-691e-4fa1-9840-8f436fa17f0d from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:43:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:43:54 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:43:54 user nova-compute[74080]:   <source dev="/dev/sdd"/>
Oct 16 07:43:54 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:43:54 user nova-compute[74080]:   <serial>6c3a1050-fb68-46fe-b2e0-d6d6eb03938d</serial>
Oct 16 07:43:54 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:43:54 user nova-compute[74080]: </disk>
Oct 16 07:43:54 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:43:54 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully detached device vdb from instance d78e592d-691e-4fa1-9840-8f436fa17f0d from the persistent domain config.
Oct 16 07:43:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d78e592d-691e-4fa1-9840-8f436fa17f0d from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:43:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:43:54 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:43:54 user nova-compute[74080]:   <source dev="/dev/sdd"/>
Oct 16 07:43:54 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:43:54 user nova-compute[74080]:   <serial>6c3a1050-fb68-46fe-b2e0-d6d6eb03938d</serial>
Oct 16 07:43:54 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:43:54 user nova-compute[74080]: </disk>
Oct 16 07:43:54 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:43:55 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d78e592d-691e-4fa1-9840-8f436fa17f0d {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG nova.objects.instance [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'flavor' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:43:56 user nova-compute[74080]: INFO nova.compute.manager [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Attaching volume 960e960a-18a4-41a4-ab31-3a4927e93ff1 to /dev/vdb
Oct 16 07:43:56 user nova-compute[74080]: DEBUG os_brick.utils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcdb8be-1915-42e7-a26c-08cda1fdfd24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6cb8e-d491-4c72-a6d9-2f16b70adf2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[805bbcad-74b9-4d94-bf42-9c48e5114a7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[090c1083-4eab-4135-8f29-bc2b877e0f72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:43:56 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:43:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef627d-0a76-4d9a-83ae-8b4dbde68cc3]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG os_brick.utils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating existing volume attachment record: 2e1d6cef-16dc-4120-8cec-c185184f013b {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:43:56 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:43:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:02 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-changed-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:03 user nova-compute[74080]: DEBUG nova.compute.manager [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Refreshing instance network info cache due to event network-changed-c0d08985-d438-4228-9608-33f7c2ac6b3a. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:44:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] Acquiring lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] Acquired lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:03 user nova-compute[74080]: DEBUG nova.network.neutron [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Refreshing network info cache for port c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG nova.network.neutron [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Updated VIF entry in instance network info cache for port c0d08985-d438-4228-9608-33f7c2ac6b3a. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG nova.network.neutron [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Updating instance_info_cache with network_info: [{"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ed87c0e8-7a02-4aac-b9cf-018263bfb607 req-55f59aea-0ae4-4ae9-b87a-3b245f5c4b77 service nova] Releasing lock "refresh_cache-20180aaa-89c9-42fa-ae42-ded783acb8ec" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "20180aaa-89c9-42fa-ae42-ded783acb8ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:04 user nova-compute[74080]: INFO nova.compute.manager [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Terminating instance
Oct 16 07:44:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-ed011eab-9b0b-43bf-b72a-ecfff8082e77 req-895bd8ea-566b-4ad2-a7b9-4b101e7dc69c service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-vif-unplugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ed011eab-9b0b-43bf-b72a-ecfff8082e77 req-895bd8ea-566b-4ad2-a7b9-4b101e7dc69c service nova] Acquiring lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ed011eab-9b0b-43bf-b72a-ecfff8082e77 req-895bd8ea-566b-4ad2-a7b9-4b101e7dc69c service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ed011eab-9b0b-43bf-b72a-ecfff8082e77 req-895bd8ea-566b-4ad2-a7b9-4b101e7dc69c service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-ed011eab-9b0b-43bf-b72a-ecfff8082e77 req-895bd8ea-566b-4ad2-a7b9-4b101e7dc69c service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] No waiting events found dispatching network-vif-unplugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.compute.manager [req-ed011eab-9b0b-43bf-b72a-ecfff8082e77 req-895bd8ea-566b-4ad2-a7b9-4b101e7dc69c service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-vif-unplugged-c0d08985-d438-4228-9608-33f7c2ac6b3a for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:44:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Instance destroyed successfully.
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.objects.instance [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'resources' on Instance uuid 20180aaa-89c9-42fa-ae42-ded783acb8ec {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:42:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1576485597',display_name='tempest-TestVolumeBootPattern-server-1576485597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1576485597',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUB4evsnJY2sT1HccGkPebZAqVN/dVr0njmKk6++1K+M1J0EeXtYJ/VhykTTCYV6t+en05gMrUhPTd7ZZ42WU1pr/6VunsCqdc5GhfD3N/4gmeez4gK3GWGniO7CnDJQ==',key_name='tempest-TestVolumeBootPattern-975136939',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:42:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-2lamk1lt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:42:34Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=20180aaa-89c9-42fa-ae42-ded783acb8ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "address": "fa:16:3e:57:dd:22", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d08985-d4", "ovs_interfaceid": "c0d08985-d438-4228-9608-33f7c2ac6b3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:dd:22,bridge_name='br-int',has_traffic_filtering=True,id=c0d08985-d438-4228-9608-33f7c2ac6b3a,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d08985-d4') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_vif [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:dd:22,bridge_name='br-int',has_traffic_filtering=True,id=c0d08985-d438-4228-9608-33f7c2ac6b3a,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d08985-d4') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0d08985-d4, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41fc01b2-c0bc-404a-8f61-a5d90e05d9f3) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:05 user nova-compute[74080]: INFO os_vif [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:dd:22,bridge_name='br-int',has_traffic_filtering=True,id=c0d08985-d438-4228-9608-33f7c2ac6b3a,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d08985-d4')
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URGJHYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:05 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:05 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 is timed out.
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed3706-deb0-42ed-8ba4-2cded30726f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:44:05 user nova-compute[74080]: No targets found.
Oct 16 07:44:05 user nova-compute[74080]: iSNS:
Oct 16 07:44:05 user nova-compute[74080]: No targets found.
Oct 16 07:44:05 user nova-compute[74080]: STATIC:
Oct 16 07:44:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:44:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7
Oct 16 07:44:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:44:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84
Oct 16 07:44:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9
Oct 16 07:44:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:05 user nova-compute[74080]: FIRMWARE:
Oct 16 07:44:05 user nova-compute[74080]: No targets found.
Oct 16 07:44:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:44:05 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:44:05 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:44:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully detached device vdb from instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 from the live domain config.
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDlgrLYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:05 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a9669d-4aa5-4dd2-99cf-5c0750adb895]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[52000a7e-e51e-409a-b45f-ed53e3327473]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac41c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84'): ({'sdb'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Removing single pathed devices sdb {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[674b2d25-240c-48ca-a7e4-ca94f639211c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6174405f-178c-40b0-acb9-f9a16bfab64c]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flushing IO for device /dev/sdb {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca63f1-7803-4832-951a-a411e7ff435e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13c1bf4-9321-4fb5-a4d9-7203358b1b41]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7535fcb-dbcf-475d-875c-a4013fafa6f0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a20d8e-4eb3-4a85-a418-ea244d4e0c80]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260]
Oct 16 07:44:06 user nova-compute[74080]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260] successful.
Oct 16 07:44:06 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[079dfe60-26f8-4d18-ab54-4a7cf77f9d04]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== disconnect_volume: return (390ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:44:06 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Deleting instance files /opt/stack/data/nova/instances/20180aaa-89c9-42fa-ae42-ded783acb8ec_del
Oct 16 07:44:06 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Deletion of /opt/stack/data/nova/instances/20180aaa-89c9-42fa-ae42-ded783acb8ec_del complete
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.346s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c38fb0-5cde-4d6c-9b09-1e2825f8ca2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:44:06 user nova-compute[74080]: No targets found.
Oct 16 07:44:06 user nova-compute[74080]: iSNS:
Oct 16 07:44:06 user nova-compute[74080]: No targets found.
Oct 16 07:44:06 user nova-compute[74080]: STATIC:
Oct 16 07:44:06 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:44:06 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:06 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:06 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7
Oct 16 07:44:06 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:06 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:06 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:44:06 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:06 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:06 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9
Oct 16 07:44:06 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:06 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:06 user nova-compute[74080]: FIRMWARE:
Oct 16 07:44:06 user nova-compute[74080]: No targets found.
Oct 16 07:44:06 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:44:06 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:44:06 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc15d27-9d23-40bc-9cc3-9c9df7d0475e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: INFO nova.compute.manager [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c929167-0d5b-40c6-adb4-b229402bd9ec]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:06 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:06 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:44:06 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:06 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:06 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:06 user nova-compute[74080]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 (non-flash)
Oct 16 07:44:06 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:06 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac7be200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9'): ({'sdc'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Removing single pathed devices sdc {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49312a2-dffb-457c-955b-3222f4c9eaab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79232690-bc91-4c70-b6ae-6c78864263f1]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Flushing IO for device /dev/sdc {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8965f2-cb1a-4e5f-ba22-ebdf9924442d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f88a44f-f242-4638-b7f1-2e0a3b9b9a4e]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e5bc6-dd07-4ea9-819a-2afe8c06a012]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46754e4-09f7-4144-ba28-88bf75d894c4]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260]
Oct 16 07:44:06 user nova-compute[74080]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9, portal: 172.16.0.220,3260] successful.
Oct 16 07:44:06 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab459055-3f09-44ea-89db-af2ea9d70950]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== disconnect_volume: return (716ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-fb716138-af50-4b89-a9d3-d6ac40e56d2b req-9ba8379c-f944-45a7-ab5a-4e099e09652b service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fb716138-af50-4b89-a9d3-d6ac40e56d2b req-9ba8379c-f944-45a7-ab5a-4e099e09652b service nova] Acquiring lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fb716138-af50-4b89-a9d3-d6ac40e56d2b req-9ba8379c-f944-45a7-ab5a-4e099e09652b service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fb716138-af50-4b89-a9d3-d6ac40e56d2b req-9ba8379c-f944-45a7-ab5a-4e099e09652b service nova] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-fb716138-af50-4b89-a9d3-d6ac40e56d2b req-9ba8379c-f944-45a7-ab5a-4e099e09652b service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] No waiting events found dispatching network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:07 user nova-compute[74080]: WARNING nova.compute.manager [req-fb716138-af50-4b89-a9d3-d6ac40e56d2b req-9ba8379c-f944-45a7-ab5a-4e099e09652b service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received unexpected event network-vif-plugged-c0d08985-d438-4228-9608-33f7c2ac6b3a for instance with vm_state active and task_state deleting.
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'flavor' on Instance uuid ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2967f018-4ba2-4e2a-bdbc-ef4d1346b031 tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.315s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.175s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:07 user nova-compute[74080]: INFO nova.compute.manager [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Terminating instance
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:07 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Took 1.29 seconds to deallocate network for instance.
Oct 16 07:44:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-f4af6a61-1e15-4d14-adec-a7839addb94a req-488e6958-e531-40c2-a627-56c70c28e118 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-vif-unplugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f4af6a61-1e15-4d14-adec-a7839addb94a req-488e6958-e531-40c2-a627-56c70c28e118 service nova] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f4af6a61-1e15-4d14-adec-a7839addb94a req-488e6958-e531-40c2-a627-56c70c28e118 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f4af6a61-1e15-4d14-adec-a7839addb94a req-488e6958-e531-40c2-a627-56c70c28e118 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-f4af6a61-1e15-4d14-adec-a7839addb94a req-488e6958-e531-40c2-a627-56c70c28e118 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] No waiting events found dispatching network-vif-unplugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-f4af6a61-1e15-4d14-adec-a7839addb94a req-488e6958-e531-40c2-a627-56c70c28e118 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-vif-unplugged-38df3710-5b78-4ec5-963b-42f349b9c387 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:08 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Instance destroyed successfully.
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.objects.instance [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lazy-loading 'resources' on Instance uuid ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1492485079',display_name='tempest-VolumesSnapshotTestJSON-instance-1492485079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1492485079',id=30,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxZSP2FWXmFm13pKrU2RlH3TeRY0wSePQm2TY3KlnJfnz9RtV8lLLkRZXG+g3+EAgvixXC3z9kAEjYTiu5o+4eFT65HrmvE/gu25IraPa+/dZIzDvHSWgwUy+AQBSruLw==',key_name='tempest-keypair-587015676',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dbb580495c34728bb3d06e92842737d',ramdisk_id='',reservation_id='r-60qt8c7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-389413629',owner_user_name='tempest-VolumesSnapshotTestJSON-389413629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:40:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69562ed193c74ec0815d41cbe9b662c1',uuid=ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converting VIF {"id": "38df3710-5b78-4ec5-963b-42f349b9c387", "address": "fa:16:3e:38:64:ae", "network": {"id": "e7613b8d-a19f-4c4e-bd06-69019ef96730", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1932110878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dbb580495c34728bb3d06e92842737d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38df3710-5b", "ovs_interfaceid": "38df3710-5b78-4ec5-963b-42f349b9c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:64:ae,bridge_name='br-int',has_traffic_filtering=True,id=38df3710-5b78-4ec5-963b-42f349b9c387,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38df3710-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_vif [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:64:ae,bridge_name='br-int',has_traffic_filtering=True,id=38df3710-5b78-4ec5-963b-42f349b9c387,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38df3710-5b') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38df3710-5b, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c66b189b-f38f-4bc9-800d-6e5cbccb8a95) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:08 user nova-compute[74080]: INFO os_vif [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:64:ae,bridge_name='br-int',has_traffic_filtering=True,id=38df3710-5b78-4ec5-963b-42f349b9c387,network=Network(e7613b8d-a19f-4c4e-bd06-69019ef96730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38df3710-5b')
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDlgrLYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:08 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579c60b-479d-42a5-8367-ed4995733791]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:44:08 user nova-compute[74080]: No targets found.
Oct 16 07:44:08 user nova-compute[74080]: iSNS:
Oct 16 07:44:08 user nova-compute[74080]: No targets found.
Oct 16 07:44:08 user nova-compute[74080]: STATIC:
Oct 16 07:44:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:44:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7
Oct 16 07:44:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:08 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:44:08 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:08 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:08 user nova-compute[74080]: FIRMWARE:
Oct 16 07:44:08 user nova-compute[74080]: No targets found.
Oct 16 07:44:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:44:08 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:44:08 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e281ac5-7813-4877-90fd-b359dc439eb9', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb99b72-5568-4b11-836b-d8d30202b44e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a897d2-ce0e-486e-bd6a-c2edd46ea81b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:08 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:08 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:08 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:08 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:08 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac258b80>, {}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Disconnecting from: [] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] <== disconnect_volume: return (94ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:44:08 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Deleting instance files /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9_del
Oct 16 07:44:08 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Deletion of /opt/stack/data/nova/instances/ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9_del complete
Oct 16 07:44:08 user nova-compute[74080]: INFO nova.compute.manager [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Took 1.00 seconds to detach 1 volumes for instance.
Oct 16 07:44:08 user nova-compute[74080]: INFO nova.compute.manager [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:09 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Deleted allocations for instance 20180aaa-89c9-42fa-ae42-ded783acb8ec
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-652424a5-1bea-4911-8fcf-272b2e337739 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "20180aaa-89c9-42fa-ae42-ded783acb8ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.286s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-20ff4357-652c-43db-8df5-4fd3521d08a0 req-de9a8e1b-f367-4e8b-8c0d-a267f8d140fc service nova] [instance: 20180aaa-89c9-42fa-ae42-ded783acb8ec] Received event network-vif-deleted-c0d08985-d438-4228-9608-33f7c2ac6b3a {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:09 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Took 0.98 seconds to deallocate network for instance.
Oct 16 07:44:09 user nova-compute[74080]: WARNING nova.volume.cinder [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Attachment 96b7017f-afce-42fb-8376-c5627c94a932 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 96b7017f-afce-42fb-8376-c5627c94a932. (HTTP 404) (Request-ID: req-23dfdac6-a3e9-4eaf-ae77-aa2f66ce5113)
Oct 16 07:44:09 user nova-compute[74080]: INFO nova.compute.manager [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Took 0.03 seconds to detach 1 volumes for instance.
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-ddfc8f17-3557-4a57-896e-13301be81767 req-4ce9222a-1946-41f8-9ff9-cc07c8cf47c8 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ddfc8f17-3557-4a57-896e-13301be81767 req-4ce9222a-1946-41f8-9ff9-cc07c8cf47c8 service nova] Acquiring lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ddfc8f17-3557-4a57-896e-13301be81767 req-4ce9222a-1946-41f8-9ff9-cc07c8cf47c8 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-ddfc8f17-3557-4a57-896e-13301be81767 req-4ce9222a-1946-41f8-9ff9-cc07c8cf47c8 service nova] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-ddfc8f17-3557-4a57-896e-13301be81767 req-4ce9222a-1946-41f8-9ff9-cc07c8cf47c8 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] No waiting events found dispatching network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:09 user nova-compute[74080]: WARNING nova.compute.manager [req-ddfc8f17-3557-4a57-896e-13301be81767 req-4ce9222a-1946-41f8-9ff9-cc07c8cf47c8 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received unexpected event network-vif-plugged-38df3710-5b78-4ec5-963b-42f349b9c387 for instance with vm_state deleted and task_state None.
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.365s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:44:10 user nova-compute[74080]: INFO nova.compute.claims [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Claim successful on node user
Oct 16 07:44:10 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Deleted allocations for instance ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-10cf039b-8ad5-4fd3-a3ae-509dbbe6548e tempest-VolumesSnapshotTestJSON-389413629 tempest-VolumesSnapshotTestJSON-389413629-project-member] Lock "ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.786s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:44:10 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.policy [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e555075cd0d49f9af33eb6ebfe8d55a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c87d6996a3e46d19f45367113c987c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:44:10 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Creating image(s)
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "/opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "/opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "/opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:10 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk 1073741824" returned: 0 in 0.067s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Successfully created port: 6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG nova.compute.manager [req-1395b462-2cee-45fa-9f77-c48b5bfe4b49 req-13c3ea82-7826-45b2-aa8f-d12f5c17f745 service nova] [instance: ed0c5d59-428a-44c7-a3b8-0ea0ff0281a9] Received event network-vif-deleted-38df3710-5b78-4ec5-963b-42f349b9c387 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Cannot resize image /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Ensure instance console log exists: /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Successfully updated port: 6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquired lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.neutron [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updating instance_info_cache with network_info: [{"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Releasing lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Instance network_info: |[{"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Start _get_guest_xml network_info=[{"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:44:12 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:12 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1455862404',display_name='tempest-AttachVolumeTestJSON-server-1455862404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1455862404',id=34,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx2bsJOy5Jh4F2Vns3/T0nhCci00q88enGb4/8EFTk7d3V6/mW8Haj4Ungk0lY+xtnUPzVQs45jLGCCBTAqKHUF7YtZpLoHMwTsfXQ2Pq+wpqwPKZLxDNRMT+qI6vRJgQ==',key_name='tempest-keypair-690391574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-kf5cbci7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:13:c2,bridge_name='br-int',has_traffic_filtering=True,id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6310f7ae-bb') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.objects.instance [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'pci_devices' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:44:12 user nova-compute[74080]:   <uuid>99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f</uuid>
Oct 16 07:44:12 user nova-compute[74080]:   <name>instance-00000022</name>
Oct 16 07:44:12 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:44:12 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:44:12 user nova-compute[74080]:   <metadata>
Oct 16 07:44:12 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:44:12 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:44:12 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeTestJSON-server-1455862404</nova:name>
Oct 16 07:44:12 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:44:12</nova:creationTime>
Oct 16 07:44:12 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:44:12 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:44:12 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:44:12 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:44:12 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:44:12 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:44:12 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:44:12 user nova-compute[74080]:       <nova:owner>
Oct 16 07:44:12 user nova-compute[74080]:         <nova:user uuid="3e555075cd0d49f9af33eb6ebfe8d55a">tempest-AttachVolumeTestJSON-1619996160-project-member</nova:user>
Oct 16 07:44:12 user nova-compute[74080]:         <nova:project uuid="7c87d6996a3e46d19f45367113c987c9">tempest-AttachVolumeTestJSON-1619996160</nova:project>
Oct 16 07:44:12 user nova-compute[74080]:       </nova:owner>
Oct 16 07:44:12 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:44:12 user nova-compute[74080]:       <nova:ports>
Oct 16 07:44:12 user nova-compute[74080]:         <nova:port uuid="6310f7ae-bb5b-4bcb-9eff-e1c20483e948">
Oct 16 07:44:12 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 07:44:12 user nova-compute[74080]:         </nova:port>
Oct 16 07:44:12 user nova-compute[74080]:       </nova:ports>
Oct 16 07:44:12 user nova-compute[74080]:     </nova:instance>
Oct 16 07:44:12 user nova-compute[74080]:   </metadata>
Oct 16 07:44:12 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:44:12 user nova-compute[74080]:     <system>
Oct 16 07:44:12 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:44:12 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:44:12 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:44:12 user nova-compute[74080]:       <entry name="serial">99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f</entry>
Oct 16 07:44:12 user nova-compute[74080]:       <entry name="uuid">99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f</entry>
Oct 16 07:44:12 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:44:12 user nova-compute[74080]:     </system>
Oct 16 07:44:12 user nova-compute[74080]:   </sysinfo>
Oct 16 07:44:12 user nova-compute[74080]:   <os>
Oct 16 07:44:12 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:44:12 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:44:12 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:44:12 user nova-compute[74080]:   </os>
Oct 16 07:44:12 user nova-compute[74080]:   <features>
Oct 16 07:44:12 user nova-compute[74080]:     <acpi/>
Oct 16 07:44:12 user nova-compute[74080]:     <apic/>
Oct 16 07:44:12 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:44:12 user nova-compute[74080]:   </features>
Oct 16 07:44:12 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:44:12 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:44:12 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:44:12 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:44:12 user nova-compute[74080]:   </clock>
Oct 16 07:44:12 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:44:12 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:44:12 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:44:12 user nova-compute[74080]:   </cpu>
Oct 16 07:44:12 user nova-compute[74080]:   <devices>
Oct 16 07:44:12 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:44:12 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:44:12 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk"/>
Oct 16 07:44:12 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:44:12 user nova-compute[74080]:     </disk>
Oct 16 07:44:12 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:44:12 user nova-compute[74080]:       <mac address="fa:16:3e:42:13:c2"/>
Oct 16 07:44:12 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:44:12 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:44:12 user nova-compute[74080]:       <target dev="tap6310f7ae-bb"/>
Oct 16 07:44:12 user nova-compute[74080]:     </interface>
Oct 16 07:44:12 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:44:12 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/console.log" append="off"/>
Oct 16 07:44:12 user nova-compute[74080]:     </serial>
Oct 16 07:44:12 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:44:12 user nova-compute[74080]:     <video>
Oct 16 07:44:12 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:44:12 user nova-compute[74080]:     </video>
Oct 16 07:44:12 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:44:12 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:44:12 user nova-compute[74080]:     </rng>
Oct 16 07:44:12 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:44:12 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:44:12 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:44:12 user nova-compute[74080]:     </memballoon>
Oct 16 07:44:12 user nova-compute[74080]:   </devices>
Oct 16 07:44:12 user nova-compute[74080]: </domain>
Oct 16 07:44:12 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1455862404',display_name='tempest-AttachVolumeTestJSON-server-1455862404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1455862404',id=34,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx2bsJOy5Jh4F2Vns3/T0nhCci00q88enGb4/8EFTk7d3V6/mW8Haj4Ungk0lY+xtnUPzVQs45jLGCCBTAqKHUF7YtZpLoHMwTsfXQ2Pq+wpqwPKZLxDNRMT+qI6vRJgQ==',key_name='tempest-keypair-690391574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-kf5cbci7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:44:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:13:c2,bridge_name='br-int',has_traffic_filtering=True,id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6310f7ae-bb') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG os_vif [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:13:c2,bridge_name='br-int',has_traffic_filtering=True,id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6310f7ae-bb') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f63ab56e-deb8-5e81-bd99-3940b148160f', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6310f7ae-bb, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6310f7ae-bb, col_values=(('qos', UUID('ddf76519-f5bb-433f-a020-6bfd4de59882')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6310f7ae-bb, col_values=(('external_ids', {'iface-id': '6310f7ae-bb5b-4bcb-9eff-e1c20483e948', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:13:c2', 'vm-uuid': '99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:12 user nova-compute[74080]: INFO os_vif [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:13:c2,bridge_name='br-int',has_traffic_filtering=True,id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6310f7ae-bb')
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:12 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No VIF found with MAC fa:16:3e:42:13:c2, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:44:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-changed-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Refreshing instance network info cache due to event network-changed-6310f7ae-bb5b-4bcb-9eff-e1c20483e948. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:44:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] Acquiring lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] Acquired lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:13 user nova-compute[74080]: DEBUG nova.network.neutron [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Refreshing network info cache for port 6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updated VIF entry in instance network info cache for port 6310f7ae-bb5b-4bcb-9eff-e1c20483e948. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG nova.network.neutron [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updating instance_info_cache with network_info: [{"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7f43db4-3b4a-4cd3-a4ef-4cb44cf25cf9 req-6e3d19fa-e49f-4751-8957-a6a72db30472 service nova] Releasing lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-0bde247a-77ab-4409-a4f3-05363fdc7891 req-62a22c55-b5c1-487d-807f-5d902592126f service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0bde247a-77ab-4409-a4f3-05363fdc7891 req-62a22c55-b5c1-487d-807f-5d902592126f service nova] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0bde247a-77ab-4409-a4f3-05363fdc7891 req-62a22c55-b5c1-487d-807f-5d902592126f service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-0bde247a-77ab-4409-a4f3-05363fdc7891 req-62a22c55-b5c1-487d-807f-5d902592126f service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-0bde247a-77ab-4409-a4f3-05363fdc7891 req-62a22c55-b5c1-487d-807f-5d902592126f service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] No waiting events found dispatching network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:14 user nova-compute[74080]: WARNING nova.compute.manager [req-0bde247a-77ab-4409-a4f3-05363fdc7891 req-62a22c55-b5c1-487d-807f-5d902592126f service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received unexpected event network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 for instance with vm_state building and task_state spawning.
Oct 16 07:44:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:14 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:15 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d78e592d-691e-4fa1-9840-8f436fa17f0d is timed out.
Oct 16 07:44:15 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully detached device vdb from instance d78e592d-691e-4fa1-9840-8f436fa17f0d from the live domain config.
Oct 16 07:44:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IeaYpBEt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:15 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fca9b9c-3d50-4341-9132-5606b35a1031]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:44:15 user nova-compute[74080]: No targets found.
Oct 16 07:44:15 user nova-compute[74080]: iSNS:
Oct 16 07:44:15 user nova-compute[74080]: No targets found.
Oct 16 07:44:15 user nova-compute[74080]: STATIC:
Oct 16 07:44:15 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d
Oct 16 07:44:15 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:15 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:15 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7
Oct 16 07:44:15 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:15 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:15 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:44:15 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:15 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:15 user nova-compute[74080]: FIRMWARE:
Oct 16 07:44:15 user nova-compute[74080]: No targets found.
Oct 16 07:44:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:44:15 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:44:15 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b7297-3a57-496f-90fa-b74cad052115]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e3e03-a192-4518-97f6-b5f9c2aec01e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:15 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:15 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:15 user nova-compute[74080]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d (non-flash)
Oct 16 07:44:15 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac3893f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d'): ({'sdd'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Removing single pathed devices sdd {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5903d03-7228-4a30-a56a-8746efd5f63c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbe9f51-7bdf-453c-a60a-7a6dcd480294]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flushing IO for device /dev/sdd {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e718ab-e4bf-4c2d-9bdf-ac2f21ae7a70]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[03090c64-68d3-40f3-894c-eefbb276b7ba]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfc24c8-c707-48b9-93c2-6bf93c8d57c7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc67f45-5575-4a51-921b-f3a4e2aa4d36]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260]
Oct 16 07:44:15 user nova-compute[74080]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d, portal: 172.16.0.220,3260] successful.
Oct 16 07:44:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c3a1050-fb68-46fe-b2e0-d6d6eb03938d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff55ade3-125e-4add-bffd-2f93c2642b93]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== disconnect_volume: return (287ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:15 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.compute.manager [req-8e399a0a-6e4a-4722-98cb-4325b954033a req-cdf74f25-ba6c-464d-bbca-8dd71debae03 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8e399a0a-6e4a-4722-98cb-4325b954033a req-cdf74f25-ba6c-464d-bbca-8dd71debae03 service nova] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8e399a0a-6e4a-4722-98cb-4325b954033a req-cdf74f25-ba6c-464d-bbca-8dd71debae03 service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-8e399a0a-6e4a-4722-98cb-4325b954033a req-cdf74f25-ba6c-464d-bbca-8dd71debae03 service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.compute.manager [req-8e399a0a-6e4a-4722-98cb-4325b954033a req-cdf74f25-ba6c-464d-bbca-8dd71debae03 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] No waiting events found dispatching network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:16 user nova-compute[74080]: WARNING nova.compute.manager [req-8e399a0a-6e4a-4722-98cb-4325b954033a req-cdf74f25-ba6c-464d-bbca-8dd71debae03 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received unexpected event network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 for instance with vm_state building and task_state spawning.
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:44:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Instance spawned successfully.
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:16 user nova-compute[74080]: INFO nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:16 user nova-compute[74080]: INFO nova.compute.manager [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Detaching volume 6b19066e-062f-425b-9ab5-a7de1989b9c7
Oct 16 07:44:16 user nova-compute[74080]: INFO nova.compute.manager [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Took 6.97 seconds to build instance.
Oct 16 07:44:16 user nova-compute[74080]: INFO nova.virt.block_device [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Attempting to driver detach volume 6b19066e-062f-425b-9ab5-a7de1989b9c7 from mountpoint /dev/vdc
Oct 16 07:44:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-c8eecccc-08e5-4168-bb30-44ce8edd9b99 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.075s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Attempting to detach device vdc from instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:44:16 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:44:16 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:44:16 user nova-compute[74080]:   <target dev="vdc" bus="virtio"/>
Oct 16 07:44:16 user nova-compute[74080]:   <serial>6b19066e-062f-425b-9ab5-a7de1989b9c7</serial>
Oct 16 07:44:16 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:44:16 user nova-compute[74080]: </disk>
Oct 16 07:44:16 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:44:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully detached device vdc from instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 from the persistent domain config.
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:44:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:44:16 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:44:16 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:44:16 user nova-compute[74080]:   <target dev="vdc" bus="virtio"/>
Oct 16 07:44:16 user nova-compute[74080]:   <serial>6b19066e-062f-425b-9ab5-a7de1989b9c7</serial>
Oct 16 07:44:16 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 07:44:16 user nova-compute[74080]: </disk>
Oct 16 07:44:16 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:44:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:44:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Updating instance_info_cache with network_info: [{"id": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "address": "fa:16:3e:1e:d9:87", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddb9b43e-33", "ovs_interfaceid": "ddb9b43e-338c-42c6-a93b-80c3a638c387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Received event network-changed-2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG nova.compute.manager [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Refreshing instance network info cache due to event network-changed-2259665f-79d5-4598-9d39-e450ec93e111. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] Acquiring lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] Acquired lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:22 user nova-compute[74080]: DEBUG nova.network.neutron [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Refreshing network info cache for port 2259665f-79d5-4598-9d39-e450ec93e111 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Updated VIF entry in instance network info cache for port 2259665f-79d5-4598-9d39-e450ec93e111. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG nova.network.neutron [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Updating instance_info_cache with network_info: [{"id": "2259665f-79d5-4598-9d39-e450ec93e111", "address": "fa:16:3e:13:85:d1", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2259665f-79", "ovs_interfaceid": "2259665f-79d5-4598-9d39-e450ec93e111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-cc96c16b-5c1a-4979-bce1-59609da87ed7 req-0de836cd-5c21-4613-a92a-1de34e968954 service nova] Releasing lock "refresh_cache-bc44f5cc-26d8-4ff2-a868-432143effed3" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "bc44f5cc-26d8-4ff2-a868-432143effed3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG nova.objects.instance [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'flavor' on Instance uuid bc44f5cc-26d8-4ff2-a868-432143effed3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "bc44f5cc-26d8-4ff2-a868-432143effed3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:23 user nova-compute[74080]: INFO nova.compute.manager [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Attaching volume 679352ee-4119-4edf-a823-fed8109c2637 to /dev/vdb
Oct 16 07:44:23 user nova-compute[74080]: DEBUG os_brick.utils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a23c9-cf81-49b8-9e66-a1e26eaebaf2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c271f3a-c397-4a40-b318-3a2959e52acb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[34494b41-5f57-4e93-ae66-d510dd155426]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d964ff5b-be78-43a7-b59a-1695158680fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:44:23 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:44:23 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a537d5-155f-449f-99b2-b560895d42d0]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG os_brick.utils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:23 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Updating existing volume attachment record: eff5389c-3d8c-4ac5-88ab-0998e69490a1 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:44:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:26 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:27 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG nova.objects.instance [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'flavor' on Instance uuid d78e592d-691e-4fa1-9840-8f436fa17f0d {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-180b5db7-e0c4-4c12-a545-78afae872b15 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.652s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcuwjUkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:29 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:29 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:29 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc24d6e-286c-4e0a-9676-17d2b15eb51c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:44:29 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[498390dd-6348-4529-8ee7-68db77867ef4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1] added
Oct 16 07:44:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b56aead-614b-492b-be4c-49f5b8d7f19b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e1d05-f469-423a-950c-482a5cd2f010]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcuwjUkX {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcuwjUkX" returned: 0 in 0.082s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61ea02e-97a6-44ca-8120-6b90356cb213]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcuwjUkX'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9c554f-ed9b-4303-91e4-00d41f0737f6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bf5b53-830a-4ede-a260-8a0ea2c1fb15]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:29 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:29 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e048020-1bd0-40c9-8317-1c965101e9bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260]
Oct 16 07:44:29 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260] successful.
Oct 16 07:44:29 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[126cf4a9-8e0a-412f-8335-78e5c4b1e150]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3837e4-d848-4c32-9144-30595b2717da]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:30 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:30 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:30 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:30 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:30 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.533s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c93d89-47e3-410f-be64-443a851094dc]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcuwjUkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.582s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] <== connect_volume: return (1586ms) {'type': 'block', 'scsi_wwn': '23037646361663136', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037646361663136', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG nova.objects.instance [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'flavor' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:44:31 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:44:31 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:44:31 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:44:31 user nova-compute[74080]:   <serial>960e960a-18a4-41a4-ab31-3a4927e93ff1</serial>
Oct 16 07:44:31 user nova-compute[74080]: </disk>
Oct 16 07:44:31 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No VIF found with MAC fa:16:3e:f1:12:22, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-48d0e979-acc6-4302-b874-7e246b9f02a4 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.207s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:32 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:32 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7205MB free_disk=25.00951385498047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d78e592d-691e-4fa1-9840-8f436fa17f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance bc44f5cc-26d8-4ff2-a868-432143effed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 816158fd-6a77-4d53-9cdb-09707887bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:44:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:33 user nova-compute[74080]: INFO nova.compute.manager [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Rescuing
Oct 16 07:44:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquired lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74080) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG nova.network.neutron [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Releasing lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-b1af9797-2d13-4b6c-89fa-284024669914 req-2eed648a-ad61-4a0b-80a3-f205e6bd5b84 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b1af9797-2d13-4b6c-89fa-284024669914 req-2eed648a-ad61-4a0b-80a3-f205e6bd5b84 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b1af9797-2d13-4b6c-89fa-284024669914 req-2eed648a-ad61-4a0b-80a3-f205e6bd5b84 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b1af9797-2d13-4b6c-89fa-284024669914 req-2eed648a-ad61-4a0b-80a3-f205e6bd5b84 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG nova.compute.manager [req-b1af9797-2d13-4b6c-89fa-284024669914 req-2eed648a-ad61-4a0b-80a3-f205e6bd5b84 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:34 user nova-compute[74080]: WARNING nova.compute.manager [req-b1af9797-2d13-4b6c-89fa-284024669914 req-2eed648a-ad61-4a0b-80a3-f205e6bd5b84 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state active and task_state rescuing.
Oct 16 07:44:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance destroyed successfully.
Oct 16 07:44:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Attempting a stable device rescue
Oct 16 07:44:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance directory exists: not creating {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 07:44:34 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Creating image(s)
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'trusted_certs' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "e7e2e6cb66bd403f9d48dab572cbaf8cf3741904" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "e7e2e6cb66bd403f9d48dab572cbaf8cf3741904" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:35 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.virt.images [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] 37c13eeb-0858-4ddc-8626-2ffa55ca87a1 was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.part /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-05902f8b-a0db-4f61-935e-78a43b72c292 req-dcce9b0a-242b-4c5d-a9b2-24839d3400a4 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-05902f8b-a0db-4f61-935e-78a43b72c292 req-dcce9b0a-242b-4c5d-a9b2-24839d3400a4 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-05902f8b-a0db-4f61-935e-78a43b72c292 req-dcce9b0a-242b-4c5d-a9b2-24839d3400a4 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-05902f8b-a0db-4f61-935e-78a43b72c292 req-dcce9b0a-242b-4c5d-a9b2-24839d3400a4 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.compute.manager [req-05902f8b-a0db-4f61-935e-78a43b72c292 req-dcce9b0a-242b-4c5d-a9b2-24839d3400a4 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:36 user nova-compute[74080]: WARNING nova.compute.manager [req-05902f8b-a0db-4f61-935e-78a43b72c292 req-dcce9b0a-242b-4c5d-a9b2-24839d3400a4 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state active and task_state rescuing.
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.part /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.converted" returned: 0 in 0.357s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "e7e2e6cb66bd403f9d48dab572cbaf8cf3741904" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.793s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "e7e2e6cb66bd403f9d48dab572cbaf8cf3741904" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "e7e2e6cb66bd403f9d48dab572cbaf8cf3741904" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904 --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904,backing_fmt=raw /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.rescue {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7e2e6cb66bd403f9d48dab572cbaf8cf3741904,backing_fmt=raw /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.rescue" returned: 0 in 0.062s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "e7e2e6cb66bd403f9d48dab572cbaf8cf3741904" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'migration_context' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.objects.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Object Instance<b50a04d5-3359-4be0-879a-0fc018b0ed3e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Start _get_guest_xml network_info=[{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "vif_mac": "fa:16:3e:f1:12:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '37c13eeb-0858-4ddc-8626-2ffa55ca87a1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '2e1d6cef-16dc-4120-8cec-c185184f013b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcuwjUkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b50a04d5-3359-4be0-879a-0fc018b0ed3e', 'attached_at': '', 'detached_at': '', 'volume_id': '960e960a-18a4-41a4-ab31-3a4927e93ff1', 'serial': '960e960a-18a4-41a4-ab31-3a4927e93ff1'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'resources' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.objects.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Object Instance<b50a04d5-3359-4be0-879a-0fc018b0ed3e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'numa_topology' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:36 user nova-compute[74080]: DEBUG nova.objects.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Object Instance<b50a04d5-3359-4be0-879a-0fc018b0ed3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:44:36 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:36 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'vcpu_model' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.objects.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Object Instance<b50a04d5-3359-4be0-879a-0fc018b0ed3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcuwjUkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:37 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:37 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:37 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e2de7-340c-4d72-aa73-cde89510f930]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZcuwjUkX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 07:44:37 user nova-compute[74080]: node.name = iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1
Oct 16 07:44:37 user nova-compute[74080]: node.tpgt = -1
Oct 16 07:44:37 user nova-compute[74080]: node.startup = automatic
Oct 16 07:44:37 user nova-compute[74080]: node.leading_login = No
Oct 16 07:44:37 user nova-compute[74080]: iface.iscsi_ifacename = default
Oct 16 07:44:37 user nova-compute[74080]: iface.net_ifacename = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.ipaddress = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.prefix_len = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.hwaddress = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.transport_name = tcp
Oct 16 07:44:37 user nova-compute[74080]: iface.initiatorname = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.state = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.vlan_id = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.vlan_priority = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.vlan_state = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.iface_num = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.mtu = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.port = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.bootproto = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.subnet_mask = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.gateway = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_alt_client_id = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_dns = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_learn_iqn = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_vendor_id_state = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_vendor_id = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.dhcp_slp_da = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.fragmentation = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.gratuitous_arp = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.incoming_forwarding = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.tos_state = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.tos = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.ttl = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.delayed_ack = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.tcp_nagle = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.tcp_wsf_state = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.tcp_wsf = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.tcp_timer_scale = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.tcp_timestamp = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.redirect = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.def_task_mgmt_timeout = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.header_digest = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.data_digest = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.immediate_data = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.initial_r2t = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.data_seq_inorder = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.data_pdu_inorder = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.erl = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.max_receive_data_len = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.first_burst_len = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.max_outstanding_r2t = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.max_burst_len = 0
Oct 16 07:44:37 user nova-compute[74080]: iface.chap_auth = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.bidi_chap = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.strict_login_compliance = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.discovery_auth = <empty>
Oct 16 07:44:37 user nova-compute[74080]: iface.discovery_logout = <empty>
Oct 16 07:44:37 user nova-compute[74080]: node.discovery_address = <empty>
Oct 16 07:44:37 user nova-compute[74080]: node.discovery_port = 0
Oct 16 07:44:37 user nova-compute[74080]: node.discovery_type = static
Oct 16 07:44:37 user nova-compute[74080]: node.session.initial_cmdsn = 0
Oct 16 07:44:37 user nova-compute[74080]: node.session.initial_login_retry_max = 8
Oct 16 07:44:37 user nova-compute[74080]: node.session.xmit_thread_priority = -20
Oct 16 07:44:37 user nova-compute[74080]: node.session.cmds_max = 128
Oct 16 07:44:37 user nova-compute[74080]: node.session.queue_depth = 32
Oct 16 07:44:37 user nova-compute[74080]: node.session.nr_sessions = 1
Oct 16 07:44:37 user nova-compute[74080]: node.session.auth.authmethod = CHAP
Oct 16 07:44:37 user nova-compute[74080]: node.session.auth.username = ZcuwjUkX
Oct 16 07:44:37 user nova-compute[74080]: node.session.auth.password = ***
Oct 16 07:44:37 user nova-compute[74080]: node.session.auth.username_in = <empty>
Oct 16 07:44:37 user nova-compute[74080]: node.session.auth.password_in = <empty>
Oct 16 07:44:37 user nova-compute[74080]: node.session.auth.chap_algs = MD5
Oct 16 07:44:37 user nova-compute[74080]: node.session.timeo.replacement_timeout = 120
Oct 16 07:44:37 user nova-compute[74080]: node.session.err_timeo.abort_timeout = 15
Oct 16 07:44:37 user nova-compute[74080]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 07:44:37 user nova-compute[74080]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 07:44:37 user nova-compute[74080]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.FastAbort = Yes
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.InitialR2T = No
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.ImmediateData = Yes
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.MaxConnections = 1
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 07:44:37 user nova-compute[74080]: node.session.iscsi.ERL = 0
Oct 16 07:44:37 user nova-compute[74080]: node.session.scan = manual
Oct 16 07:44:37 user nova-compute[74080]: node.session.reopen_max = 0
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].address = 172.16.0.220
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].port = 3260
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].startup = manual
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].tcp.window_size = 524288
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].tcp.type_of_service = 0
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].timeo.logout_timeout = 15
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].timeo.login_timeout = 15
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].timeo.auth_timeout = 45
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].iscsi.DataDigest = None
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].iscsi.IFMarker = No
Oct 16 07:44:37 user nova-compute[74080]: node.conn[0].iscsi.OFMarker = No
Oct 16 07:44:37 user nova-compute[74080]: # END RECORD
Oct 16 07:44:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae53c880-3034-4fe2-978c-066b80554c58]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[16913ac8-4733-42b8-a7e8-a26a6f7976fd]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcuwjUkX {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcuwjUkX" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a9f3cc-dd9f-4261-86b2-fdec58bb7d30]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcuwjUkX'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf1210-9091-4eef-9e07-48050f5ec783]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a9ee12-d2ba-489c-b22a-c5bd464db766]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] HCTL ('33', '0', '0', 0) found on session 40 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d250f-9c6e-401d-9e4b-6f2ef92dcf7c]: (4, ('0 0 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Searching for a device in session 40 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcuwjUkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23037646361663136', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037646361663136', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:44:37 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 is timed out.
Oct 16 07:44:37 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully detached device vdc from instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 from the live domain config.
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-249230266',display_name='tempest-ServerStableDeviceRescueTest-server-249230266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-249230266',id=29,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnrYUgnNVaIXWMKCVNKUFovEiNpR42onkWyuP6mKDHHvFakfyOXGpH8jYZWabe2WfukXV1HmPadf31ItRgy/Ki2t1dXenFXypK+V2OhzZvGEAzuJYEOiEqtCecaqZQXrQ==',key_name='tempest-keypair-687037286',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:40:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73dfaec529db4de28029e7186f4dc99f',ramdisk_id='',reservation_id='r-lkd9yen0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1785898129',owner_user_name='tempest-ServerStableDeviceRescueTest-1785898129-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a7347ee6d924888a4ba0eae614a2798',uuid=b50a04d5-3359-4be0-879a-0fc018b0ed3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "vif_mac": "fa:16:3e:f1:12:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converting VIF {"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "vif_mac": "fa:16:3e:f1:12:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.objects.instance [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'pci_devices' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gofsSBLN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:37 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.objects.base [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Object Instance<b50a04d5-3359-4be0-879a-0fc018b0ed3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:44:37 user nova-compute[74080]:   <uuid>b50a04d5-3359-4be0-879a-0fc018b0ed3e</uuid>
Oct 16 07:44:37 user nova-compute[74080]:   <name>instance-0000001d</name>
Oct 16 07:44:37 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:44:37 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:44:37 user nova-compute[74080]:   <metadata>
Oct 16 07:44:37 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:44:37 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:44:37 user nova-compute[74080]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-249230266</nova:name>
Oct 16 07:44:37 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:44:36</nova:creationTime>
Oct 16 07:44:37 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:44:37 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:44:37 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:44:37 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:44:37 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:44:37 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:44:37 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:44:37 user nova-compute[74080]:       <nova:owner>
Oct 16 07:44:37 user nova-compute[74080]:         <nova:user uuid="4a7347ee6d924888a4ba0eae614a2798">tempest-ServerStableDeviceRescueTest-1785898129-project-member</nova:user>
Oct 16 07:44:37 user nova-compute[74080]:         <nova:project uuid="73dfaec529db4de28029e7186f4dc99f">tempest-ServerStableDeviceRescueTest-1785898129</nova:project>
Oct 16 07:44:37 user nova-compute[74080]:       </nova:owner>
Oct 16 07:44:37 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:44:37 user nova-compute[74080]:       <nova:ports>
Oct 16 07:44:37 user nova-compute[74080]:         <nova:port uuid="d5f6c16f-cc65-486c-a75e-06889c7b1d9f">
Oct 16 07:44:37 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 07:44:37 user nova-compute[74080]:         </nova:port>
Oct 16 07:44:37 user nova-compute[74080]:       </nova:ports>
Oct 16 07:44:37 user nova-compute[74080]:     </nova:instance>
Oct 16 07:44:37 user nova-compute[74080]:   </metadata>
Oct 16 07:44:37 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:44:37 user nova-compute[74080]:     <system>
Oct 16 07:44:37 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:44:37 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:44:37 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:44:37 user nova-compute[74080]:       <entry name="serial">b50a04d5-3359-4be0-879a-0fc018b0ed3e</entry>
Oct 16 07:44:37 user nova-compute[74080]:       <entry name="uuid">b50a04d5-3359-4be0-879a-0fc018b0ed3e</entry>
Oct 16 07:44:37 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:44:37 user nova-compute[74080]:     </system>
Oct 16 07:44:37 user nova-compute[74080]:   </sysinfo>
Oct 16 07:44:37 user nova-compute[74080]:   <os>
Oct 16 07:44:37 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:44:37 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:44:37 user nova-compute[74080]:   </os>
Oct 16 07:44:37 user nova-compute[74080]:   <features>
Oct 16 07:44:37 user nova-compute[74080]:     <acpi/>
Oct 16 07:44:37 user nova-compute[74080]:     <apic/>
Oct 16 07:44:37 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:44:37 user nova-compute[74080]:   </features>
Oct 16 07:44:37 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:44:37 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:44:37 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:44:37 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:44:37 user nova-compute[74080]:   </clock>
Oct 16 07:44:37 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:44:37 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:44:37 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:44:37 user nova-compute[74080]:   </cpu>
Oct 16 07:44:37 user nova-compute[74080]:   <devices>
Oct 16 07:44:37 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:44:37 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:44:37 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk"/>
Oct 16 07:44:37 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:44:37 user nova-compute[74080]:     </disk>
Oct 16 07:44:37 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:44:37 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:44:37 user nova-compute[74080]:       <source dev="/dev/sdb"/>
Oct 16 07:44:37 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:44:37 user nova-compute[74080]:       <serial>960e960a-18a4-41a4-ab31-3a4927e93ff1</serial>
Oct 16 07:44:37 user nova-compute[74080]:     </disk>
Oct 16 07:44:37 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:44:37 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:44:37 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.rescue"/>
Oct 16 07:44:37 user nova-compute[74080]:       <target dev="vdc" bus="virtio"/>
Oct 16 07:44:37 user nova-compute[74080]:       <boot order="1"/>
Oct 16 07:44:37 user nova-compute[74080]:     </disk>
Oct 16 07:44:37 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:44:37 user nova-compute[74080]:       <mac address="fa:16:3e:f1:12:22"/>
Oct 16 07:44:37 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:44:37 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:44:37 user nova-compute[74080]:       <target dev="tapd5f6c16f-cc"/>
Oct 16 07:44:37 user nova-compute[74080]:     </interface>
Oct 16 07:44:37 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:44:37 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/console.log" append="off"/>
Oct 16 07:44:37 user nova-compute[74080]:     </serial>
Oct 16 07:44:37 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:44:37 user nova-compute[74080]:     <video>
Oct 16 07:44:37 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:44:37 user nova-compute[74080]:     </video>
Oct 16 07:44:37 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:44:37 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:44:37 user nova-compute[74080]:     </rng>
Oct 16 07:44:37 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:44:37 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:44:37 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:44:37 user nova-compute[74080]:     </memballoon>
Oct 16 07:44:37 user nova-compute[74080]:   </devices>
Oct 16 07:44:37 user nova-compute[74080]: </domain>
Oct 16 07:44:37 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:44:37 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance destroyed successfully.
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d580465-0cec-4bd4-965d-5576dbe6d31f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:44:37 user nova-compute[74080]: No targets found.
Oct 16 07:44:37 user nova-compute[74080]: iSNS:
Oct 16 07:44:37 user nova-compute[74080]: No targets found.
Oct 16 07:44:37 user nova-compute[74080]: STATIC:
Oct 16 07:44:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7
Oct 16 07:44:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:44:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:37 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1
Oct 16 07:44:37 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:44:37 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:44:37 user nova-compute[74080]: FIRMWARE:
Oct 16 07:44:37 user nova-compute[74080]: No targets found.
Oct 16 07:44:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:44:37 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:44:37 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d507fee-ee6f-4ecf-ab02-04714f4ebd53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] No VIF found with MAC fa:16:3e:f1:12:22, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738ae85-a94a-4db5-b4b6-c5837ee9c06c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7c4328700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7'): ({'sde'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Removing single pathed devices sde {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Cleaning up deleted instances {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] There are 0 instances to clean {{(pid=74080) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a99198-9af8-4e43-8aa3-dd0a4a558854]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a95b8e8-356c-4b2e-b633-8e22990915a6]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Flushing IO for device /dev/sde {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce22034-c0aa-4fdd-a7af-44caaa0f279a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa87abef-a0c2-4f6a-9269-5ba75cde37f5]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[41081d6a-90c9-423e-8c77-7b95468f1dd4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1ffd75-df73-40c4-83c2-5ee6ae54df3c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260]
Oct 16 07:44:37 user nova-compute[74080]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7, portal: 172.16.0.220,3260] successful.
Oct 16 07:44:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b19066e-062f-425b-9ab5-a7de1989b9c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79355b2a-97b7-4a74-9df8-ec0c8d7b80f9]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] <== disconnect_volume: return (371ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:44:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:38 user nova-compute[74080]: DEBUG nova.objects.instance [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'flavor' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:38 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-de455032-03cc-4a43-b029-37469eab6bbd tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.858s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-bd830735-f40f-4945-9ab3-3fe39b71336d req-bd3b88ac-9560-41aa-9699-c5196535c0da service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd830735-f40f-4945-9ab3-3fe39b71336d req-bd3b88ac-9560-41aa-9699-c5196535c0da service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd830735-f40f-4945-9ab3-3fe39b71336d req-bd3b88ac-9560-41aa-9699-c5196535c0da service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-bd830735-f40f-4945-9ab3-3fe39b71336d req-bd3b88ac-9560-41aa-9699-c5196535c0da service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:39 user nova-compute[74080]: DEBUG nova.compute.manager [req-bd830735-f40f-4945-9ab3-3fe39b71336d req-bd3b88ac-9560-41aa-9699-c5196535c0da service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:39 user nova-compute[74080]: WARNING nova.compute.manager [req-bd830735-f40f-4945-9ab3-3fe39b71336d req-bd3b88ac-9560-41aa-9699-c5196535c0da service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state active and task_state rescuing.
Oct 16 07:44:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:39 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqBxfdWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:40 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:44:40 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb922676-1c9b-4e72-9be3-0685e1f5ddc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:44:40 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[542eba51-7e1e-41d5-8a5a-04225dbb277d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637] added
Oct 16 07:44:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.051s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[805de637-0040-4b00-b274-adba10a1e93f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdd0773-12b1-4176-8f4a-fc2bac5b9e06]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqBxfdWe {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gqBxfdWe" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c1bd09-715d-4b23-a3f7-69c5fba17183]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gqBxfdWe'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9251b56-672b-4d55-8ba3-25a8ea557ad6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb617799-0abc-4b80-babc-d3746a94b6e3]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[865b128c-805b-437f-a1b8-a6dbd5ebd110]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260]
Oct 16 07:44:40 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260] successful.
Oct 16 07:44:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0b937-9346-4c8f-a6d9-d56c1ef0a210]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c06e1f-e74c-4446-b2c2-829c8d71b4f2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 (non-flash)
Oct 16 07:44:40 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5357cb81-9282-4382-b1d3-f0d188748575]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:40 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-057d47f0-9836-4480-a29b-84bd3629ec1a req-53050bd2-a5d6-43fa-a66f-e3edbb808b25 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-057d47f0-9836-4480-a29b-84bd3629ec1a req-53050bd2-a5d6-43fa-a66f-e3edbb808b25 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-057d47f0-9836-4480-a29b-84bd3629ec1a req-53050bd2-a5d6-43fa-a66f-e3edbb808b25 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-057d47f0-9836-4480-a29b-84bd3629ec1a req-53050bd2-a5d6-43fa-a66f-e3edbb808b25 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG nova.compute.manager [req-057d47f0-9836-4480-a29b-84bd3629ec1a req-53050bd2-a5d6-43fa-a66f-e3edbb808b25 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:41 user nova-compute[74080]: WARNING nova.compute.manager [req-057d47f0-9836-4480-a29b-84bd3629ec1a req-53050bd2-a5d6-43fa-a66f-e3edbb808b25 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state active and task_state rescuing.
Oct 16 07:44:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-2d107480-8cb4-46e7-91ed-f670217c9c68 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqBxfdWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23130343734336534', 'path': '/dev/sdc'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130343734336534', 'path': '/dev/sdc'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'flavor' on Instance uuid bc44f5cc-26d8-4ff2-a868-432143effed3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:44:41 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:44:41 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:44:41 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:44:41 user nova-compute[74080]:   <serial>679352ee-4119-4edf-a823-fed8109c2637</serial>
Oct 16 07:44:41 user nova-compute[74080]: </disk>
Oct 16 07:44:41 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:44:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:42 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No VIF found with MAC fa:16:3e:13:85:d1, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:44:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4e937ad9-b61c-42a2-b707-0f2a56a18160 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.699s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "bc44f5cc-26d8-4ff2-a868-432143effed3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:44 user nova-compute[74080]: INFO nova.compute.manager [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Detaching volume 679352ee-4119-4edf-a823-fed8109c2637
Oct 16 07:44:44 user nova-compute[74080]: INFO nova.virt.block_device [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Attempting to driver detach volume 679352ee-4119-4edf-a823-fed8109c2637 from mountpoint /dev/vdb
Oct 16 07:44:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Attempting to detach device vdb from instance bc44f5cc-26d8-4ff2-a868-432143effed3 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:44:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:44:44 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:44:44 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:44:44 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:44:44 user nova-compute[74080]:   <serial>679352ee-4119-4edf-a823-fed8109c2637</serial>
Oct 16 07:44:44 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:44:44 user nova-compute[74080]: </disk>
Oct 16 07:44:44 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:44:44 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Successfully detached device vdb from instance bc44f5cc-26d8-4ff2-a868-432143effed3 from the persistent domain config.
Oct 16 07:44:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc44f5cc-26d8-4ff2-a868-432143effed3 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:44:44 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:44:44 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:44:44 user nova-compute[74080]:   <source dev="/dev/sdc"/>
Oct 16 07:44:44 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:44:44 user nova-compute[74080]:   <serial>679352ee-4119-4edf-a823-fed8109c2637</serial>
Oct 16 07:44:44 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:44:44 user nova-compute[74080]: </disk>
Oct 16 07:44:44 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:44:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:44:45 user nova-compute[74080]: INFO nova.compute.claims [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Claim successful on node user
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc44f5cc-26d8-4ff2-a868-432143effed3 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:45 user nova-compute[74080]: INFO nova.compute.manager [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Terminating instance
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.network.neutron [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:44:45 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:44:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.policy [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf2fbffe5a5544dba338662d437d5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea8d62574f84ae6a83ee19b7b03c21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:44:45 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Creating image(s)
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "/opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "/opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "/opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:45 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.208s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-6daca239-1c34-476c-a970-9d3851deefbf req-22e1d4a5-c1e2-4ad3-ba7a-b2ad99939f8a service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-unplugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6daca239-1c34-476c-a970-9d3851deefbf req-22e1d4a5-c1e2-4ad3-ba7a-b2ad99939f8a service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6daca239-1c34-476c-a970-9d3851deefbf req-22e1d4a5-c1e2-4ad3-ba7a-b2ad99939f8a service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6daca239-1c34-476c-a970-9d3851deefbf req-22e1d4a5-c1e2-4ad3-ba7a-b2ad99939f8a service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-6daca239-1c34-476c-a970-9d3851deefbf req-22e1d4a5-c1e2-4ad3-ba7a-b2ad99939f8a service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-unplugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-6daca239-1c34-476c-a970-9d3851deefbf req-22e1d4a5-c1e2-4ad3-ba7a-b2ad99939f8a service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-unplugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk 1073741824" returned: 0 in 0.048s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:46 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Instance destroyed successfully.
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.objects.instance [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'resources' on Instance uuid d78e592d-691e-4fa1-9840-8f436fa17f0d {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.221s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-42157221',display_name='tempest-ServerActionsTestOtherA-server-2101783169',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-42157221',id=25,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJs9QYYmApPo/IdFZYUpvJuopfWBor9lAxprFyaOW8mIlMKQXXtBqQiy+txKogOD/oYyzWsOFmEbKYoQGKozjO5zcNKMNfcxjhdCxwKZf85uWPefm0SbTBKdqNOzO4jZ/g==',key_name='tempest-keypair-676640173',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-dta6ryi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=d78e592d-691e-4fa1-9840-8f436fa17f0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "address": "fa:16:3e:cb:9a:c4", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c3048c-e1", "ovs_interfaceid": "e8c3048c-e1f4-4b03-86cc-eb194060a682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG os_vif [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c3048c-e1, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32bab7a9-5db8-46b4-a07a-b0a24e99289a) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Successfully created port: 251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:46 user nova-compute[74080]: INFO os_vif [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:9a:c4,bridge_name='br-int',has_traffic_filtering=True,id=e8c3048c-e1f4-4b03-86cc-eb194060a682,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c3048c-e1')
Oct 16 07:44:46 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Deleting instance files /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d_del
Oct 16 07:44:46 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Deletion of /opt/stack/data/nova/instances/d78e592d-691e-4fa1-9840-8f436fa17f0d_del complete
Oct 16 07:44:46 user nova-compute[74080]: INFO nova.compute.manager [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Cannot resize image /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Ensure instance console log exists: /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-973590ed-438b-4b3b-828b-ecc7ab3a06c2 req-c287dd67-1b94-43f7-b377-72ee582fb950 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-973590ed-438b-4b3b-828b-ecc7ab3a06c2 req-c287dd67-1b94-43f7-b377-72ee582fb950 service nova] Acquiring lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-973590ed-438b-4b3b-828b-ecc7ab3a06c2 req-c287dd67-1b94-43f7-b377-72ee582fb950 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-973590ed-438b-4b3b-828b-ecc7ab3a06c2 req-c287dd67-1b94-43f7-b377-72ee582fb950 service nova] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-973590ed-438b-4b3b-828b-ecc7ab3a06c2 req-c287dd67-1b94-43f7-b377-72ee582fb950 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] No waiting events found dispatching network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:48 user nova-compute[74080]: WARNING nova.compute.manager [req-973590ed-438b-4b3b-828b-ecc7ab3a06c2 req-c287dd67-1b94-43f7-b377-72ee582fb950 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received unexpected event network-vif-plugged-e8c3048c-e1f4-4b03-86cc-eb194060a682 for instance with vm_state active and task_state deleting.
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Successfully updated port: 251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "refresh_cache-16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquired lock "refresh_cache-16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:48 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Took 1.47 seconds to deallocate network for instance.
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Updating instance_info_cache with network_info: [{"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Releasing lock "refresh_cache-16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Instance network_info: |[{"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Start _get_guest_xml network_info=[{"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:44:48 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:48 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1600873019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1600873019',id=35,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-1fkksocy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:44:46Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:87:59,bridge_name='br-int',has_traffic_filtering=True,id=251a4be9-ae12-446b-90cc-1f1aa4fd0ec3,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251a4be9-ae') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.objects.instance [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'pci_devices' on Instance uuid 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:44:48 user nova-compute[74080]:   <uuid>16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1</uuid>
Oct 16 07:44:48 user nova-compute[74080]:   <name>instance-00000023</name>
Oct 16 07:44:48 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:44:48 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:44:48 user nova-compute[74080]:   <metadata>
Oct 16 07:44:48 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:44:48 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:44:48 user nova-compute[74080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1600873019</nova:name>
Oct 16 07:44:48 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:44:48</nova:creationTime>
Oct 16 07:44:48 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:44:48 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:44:48 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:44:48 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:44:48 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:44:48 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:44:48 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:44:48 user nova-compute[74080]:       <nova:owner>
Oct 16 07:44:48 user nova-compute[74080]:         <nova:user uuid="bf2fbffe5a5544dba338662d437d5ee2">tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member</nova:user>
Oct 16 07:44:48 user nova-compute[74080]:         <nova:project uuid="cea8d62574f84ae6a83ee19b7b03c21a">tempest-ServerBootFromVolumeStableRescueTest-1639701158</nova:project>
Oct 16 07:44:48 user nova-compute[74080]:       </nova:owner>
Oct 16 07:44:48 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:44:48 user nova-compute[74080]:       <nova:ports>
Oct 16 07:44:48 user nova-compute[74080]:         <nova:port uuid="251a4be9-ae12-446b-90cc-1f1aa4fd0ec3">
Oct 16 07:44:48 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 07:44:48 user nova-compute[74080]:         </nova:port>
Oct 16 07:44:48 user nova-compute[74080]:       </nova:ports>
Oct 16 07:44:48 user nova-compute[74080]:     </nova:instance>
Oct 16 07:44:48 user nova-compute[74080]:   </metadata>
Oct 16 07:44:48 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:44:48 user nova-compute[74080]:     <system>
Oct 16 07:44:48 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:44:48 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:44:48 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:44:48 user nova-compute[74080]:       <entry name="serial">16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1</entry>
Oct 16 07:44:48 user nova-compute[74080]:       <entry name="uuid">16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1</entry>
Oct 16 07:44:48 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:44:48 user nova-compute[74080]:     </system>
Oct 16 07:44:48 user nova-compute[74080]:   </sysinfo>
Oct 16 07:44:48 user nova-compute[74080]:   <os>
Oct 16 07:44:48 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:44:48 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:44:48 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:44:48 user nova-compute[74080]:   </os>
Oct 16 07:44:48 user nova-compute[74080]:   <features>
Oct 16 07:44:48 user nova-compute[74080]:     <acpi/>
Oct 16 07:44:48 user nova-compute[74080]:     <apic/>
Oct 16 07:44:48 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:44:48 user nova-compute[74080]:   </features>
Oct 16 07:44:48 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:44:48 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:44:48 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:44:48 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:44:48 user nova-compute[74080]:   </clock>
Oct 16 07:44:48 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:44:48 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:44:48 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:44:48 user nova-compute[74080]:   </cpu>
Oct 16 07:44:48 user nova-compute[74080]:   <devices>
Oct 16 07:44:48 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:44:48 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:44:48 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk"/>
Oct 16 07:44:48 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:44:48 user nova-compute[74080]:     </disk>
Oct 16 07:44:48 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:44:48 user nova-compute[74080]:       <mac address="fa:16:3e:2e:87:59"/>
Oct 16 07:44:48 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:44:48 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:44:48 user nova-compute[74080]:       <target dev="tap251a4be9-ae"/>
Oct 16 07:44:48 user nova-compute[74080]:     </interface>
Oct 16 07:44:48 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:44:48 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/console.log" append="off"/>
Oct 16 07:44:48 user nova-compute[74080]:     </serial>
Oct 16 07:44:48 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:44:48 user nova-compute[74080]:     <video>
Oct 16 07:44:48 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:44:48 user nova-compute[74080]:     </video>
Oct 16 07:44:48 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:44:48 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:44:48 user nova-compute[74080]:     </rng>
Oct 16 07:44:48 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:44:48 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:44:48 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:44:48 user nova-compute[74080]:     </memballoon>
Oct 16 07:44:48 user nova-compute[74080]:   </devices>
Oct 16 07:44:48 user nova-compute[74080]: </domain>
Oct 16 07:44:48 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:44:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1600873019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1600873019',id=35,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-1fkksocy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:44:46Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:87:59,bridge_name='br-int',has_traffic_filtering=True,id=251a4be9-ae12-446b-90cc-1f1aa4fd0ec3,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251a4be9-ae') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG os_vif [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:87:59,bridge_name='br-int',has_traffic_filtering=True,id=251a4be9-ae12-446b-90cc-1f1aa4fd0ec3,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251a4be9-ae') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edfb2a8d-280a-5456-a3bb-0d78d6c247bf', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap251a4be9-ae, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap251a4be9-ae, col_values=(('qos', UUID('c80ebb82-3f51-431f-a61c-9453f66c903f')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap251a4be9-ae, col_values=(('external_ids', {'iface-id': '251a4be9-ae12-446b-90cc-1f1aa4fd0ec3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:87:59', 'vm-uuid': '16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:48 user nova-compute[74080]: INFO os_vif [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:87:59,bridge_name='br-int',has_traffic_filtering=True,id=251a4be9-ae12-446b-90cc-1f1aa4fd0ec3,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap251a4be9-ae')
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No VIF found with MAC fa:16:3e:2e:87:59, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:48 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Deleted allocations for instance d78e592d-691e-4fa1-9840-8f436fa17f0d
Oct 16 07:44:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-691ec04e-252f-4aca-b842-1b53a122dfae tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "d78e592d-691e-4fa1-9840-8f436fa17f0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.356s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Received event network-changed-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Refreshing instance network info cache due to event network-changed-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] Acquiring lock "refresh_cache-16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] Acquired lock "refresh_cache-16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Refreshing network info cache for port 251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-02963afc-7913-4a29-ac1e-7ef80a5c2881 req-51df5ec7-9d06-49f2-84f2-4d1fdc27e0d3 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Received event network-vif-plugged-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-02963afc-7913-4a29-ac1e-7ef80a5c2881 req-51df5ec7-9d06-49f2-84f2-4d1fdc27e0d3 service nova] Acquiring lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-02963afc-7913-4a29-ac1e-7ef80a5c2881 req-51df5ec7-9d06-49f2-84f2-4d1fdc27e0d3 service nova] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-02963afc-7913-4a29-ac1e-7ef80a5c2881 req-51df5ec7-9d06-49f2-84f2-4d1fdc27e0d3 service nova] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-02963afc-7913-4a29-ac1e-7ef80a5c2881 req-51df5ec7-9d06-49f2-84f2-4d1fdc27e0d3 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] No waiting events found dispatching network-vif-plugged-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:50 user nova-compute[74080]: WARNING nova.compute.manager [req-02963afc-7913-4a29-ac1e-7ef80a5c2881 req-51df5ec7-9d06-49f2-84f2-4d1fdc27e0d3 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Received unexpected event network-vif-plugged-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 for instance with vm_state building and task_state spawning.
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Updated VIF entry in instance network info cache for port 251a4be9-ae12-446b-90cc-1f1aa4fd0ec3. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.network.neutron [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Updating instance_info_cache with network_info: [{"id": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "address": "fa:16:3e:2e:87:59", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap251a4be9-ae", "ovs_interfaceid": "251a4be9-ae12-446b-90cc-1f1aa4fd0ec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] Releasing lock "refresh_cache-16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:50 user nova-compute[74080]: DEBUG nova.compute.manager [req-502d3a69-ce41-4d47-b95c-3b55b1ab6e6e req-feb4bd87-a2e6-4e2f-a201-3a5673fd0cd9 service nova] [instance: d78e592d-691e-4fa1-9840-8f436fa17f0d] Received event network-vif-deleted-e8c3048c-e1f4-4b03-86cc-eb194060a682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:44:52 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Instance spawned successfully.
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:44:52 user nova-compute[74080]: INFO nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Took 6.71 seconds to spawn the instance on the hypervisor.
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:44:52 user nova-compute[74080]: INFO nova.compute.manager [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Took 7.80 seconds to build instance.
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-fc5e5340-49bf-42d2-885a-c84aedae3ac6 req-af2f9b2f-6d67-4e17-ac3e-a2a2ad9cae4e service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Received event network-vif-plugged-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fc5e5340-49bf-42d2-885a-c84aedae3ac6 req-af2f9b2f-6d67-4e17-ac3e-a2a2ad9cae4e service nova] Acquiring lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fc5e5340-49bf-42d2-885a-c84aedae3ac6 req-af2f9b2f-6d67-4e17-ac3e-a2a2ad9cae4e service nova] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fc5e5340-49bf-42d2-885a-c84aedae3ac6 req-af2f9b2f-6d67-4e17-ac3e-a2a2ad9cae4e service nova] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:52 user nova-compute[74080]: DEBUG nova.compute.manager [req-fc5e5340-49bf-42d2-885a-c84aedae3ac6 req-af2f9b2f-6d67-4e17-ac3e-a2a2ad9cae4e service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] No waiting events found dispatching network-vif-plugged-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:44:52 user nova-compute[74080]: WARNING nova.compute.manager [req-fc5e5340-49bf-42d2-885a-c84aedae3ac6 req-af2f9b2f-6d67-4e17-ac3e-a2a2ad9cae4e service nova] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Received unexpected event network-vif-plugged-251a4be9-ae12-446b-90cc-1f1aa4fd0ec3 for instance with vm_state building and task_state spawning.
Oct 16 07:44:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-12ddc45a-6fcc-4b14-8b4a-f393b8151962 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.931s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:56 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:44:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:44:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:44:56 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:44:56 user nova-compute[74080]: INFO nova.compute.claims [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Claim successful on node user
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:44:57 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.policy [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33b58ae309d047548ebf29684db6037e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b70039a31c47f39f7bf1b01b4e6e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:44:57 user nova-compute[74080]: INFO nova.virt.block_device [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Booting with volume 6abde53f-ca40-4805-89b6-7274eb9fad84 at /dev/vda
Oct 16 07:44:57 user nova-compute[74080]: DEBUG os_brick.utils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5a5fdd-48f8-4ae0-a559-f93996a5ec61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbfb964-78c8-43a0-b010-10cd69256198]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3ad331-f262-446f-8bc6-8d96218ed12d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e65b348-36cb-4e96-997c-29c8fa6064c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:44:57 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:44:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1465bf9b-ccef-4360-8244-51277df90a2b]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG os_brick.utils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:44:57 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Updating existing volume attachment record: e1ac0d22-d75a-4ca7-b1db-4eecfd130f09 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Successfully created port: 74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Successfully updated port: 74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquired lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG nova.compute.manager [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Received event network-changed-74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG nova.compute.manager [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Refreshing instance network info cache due to event network-changed-74baa473-bf01-4431-b89d-a2390dd766ac. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] Acquiring lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:44:58 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Updating instance_info_cache with network_info: [{"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Releasing lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Instance network_info: |[{"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] Acquired lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG nova.network.neutron [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Refreshing network info cache for port 74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG nova.network.neutron [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Updated VIF entry in instance network info cache for port 74baa473-bf01-4431-b89d-a2390dd766ac. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG nova.network.neutron [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Updating instance_info_cache with network_info: [{"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:44:59 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-989e74f6-761a-4d29-90fe-376fa28e2f49 req-5070f838-1045-41b4-9e0e-d725a84a3a53 service nova] Releasing lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:45:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:05 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc44f5cc-26d8-4ff2-a868-432143effed3 is timed out.
Oct 16 07:45:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Successfully detached device vdb from instance bc44f5cc-26d8-4ff2-a868-432143effed3 from the live domain config.
Oct 16 07:45:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gqBxfdWe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:45:05 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd774de4-a602-40a4-8c30-65d38f16bea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:45:05 user nova-compute[74080]: No targets found.
Oct 16 07:45:05 user nova-compute[74080]: iSNS:
Oct 16 07:45:05 user nova-compute[74080]: No targets found.
Oct 16 07:45:05 user nova-compute[74080]: STATIC:
Oct 16 07:45:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637
Oct 16 07:45:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:45:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:45:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:45:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:45:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:45:05 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1
Oct 16 07:45:05 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:45:05 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:45:05 user nova-compute[74080]: FIRMWARE:
Oct 16 07:45:05 user nova-compute[74080]: No targets found.
Oct 16 07:45:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:45:05 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:45:05 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d457caf-435b-4359-82d2-8ea504efcca8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ad95e-b822-4b19-9d01-568cc437c576]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:05 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:05 user nova-compute[74080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 (non-flash)
Oct 16 07:45:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:05 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:05 user nova-compute[74080]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 (non-flash)
Oct 16 07:45:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac38a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637'): ({'sdc'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Removing single pathed devices sdc {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[386cdc31-a320-4101-98f9-1fab406adf69]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b14973-6200-4774-a701-5c8f3fc51445]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Flushing IO for device /dev/sdc {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51631958-ab24-49ae-866e-7f8f3693ea99]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20cf04a-999c-4343-bef1-9bf1c6646bf3]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] SCSI volumes sdc have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1317d6-0a32-4499-ba74-f9cef740d7de]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b8319-59fb-4ea8-9c47-cee77c46347a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260]
Oct 16 07:45:05 user nova-compute[74080]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637, portal: 172.16.0.220,3260] successful.
Oct 16 07:45:05 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:679352ee-4119-4edf-a823-fed8109c2637 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8481d12-76d1-4581-b4e3-c84b46b39feb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] <== disconnect_volume: return (329ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:45:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:07 user nova-compute[74080]: INFO nova.compute.manager [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Terminating instance
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-fc7a0c3d-abdb-4c30-8100-9762c876ac33 req-1fd8f3bf-8400-411e-bd09-48d8846ca73e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-unplugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fc7a0c3d-abdb-4c30-8100-9762c876ac33 req-1fd8f3bf-8400-411e-bd09-48d8846ca73e service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fc7a0c3d-abdb-4c30-8100-9762c876ac33 req-1fd8f3bf-8400-411e-bd09-48d8846ca73e service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-fc7a0c3d-abdb-4c30-8100-9762c876ac33 req-1fd8f3bf-8400-411e-bd09-48d8846ca73e service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-fc7a0c3d-abdb-4c30-8100-9762c876ac33 req-1fd8f3bf-8400-411e-bd09-48d8846ca73e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-unplugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.compute.manager [req-fc7a0c3d-abdb-4c30-8100-9762c876ac33 req-1fd8f3bf-8400-411e-bd09-48d8846ca73e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-unplugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:45:07 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Instance destroyed successfully.
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.objects.instance [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'resources' on Instance uuid d3e5e8b9-5b6f-446a-aabe-2944817a3756 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T07:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1117384875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1117384875',id=27,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeOc6LSMg448zm8oKp/CpvM45DyfJHK3JogQFSdvOw52HcyFNVd6oqizTCDKiNffHJwyyEUp8xQTjfbCIeH4Pmt/3ZETdBYDJNEqoJ1MFg8dUL7Ck+E0j406SgVFQNCVg==',key_name='tempest-keypair-1371470985',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-nvxk32j9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=d3e5e8b9-5b6f-446a-aabe-2944817a3756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "address": "fa:16:3e:bb:fd:24", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdab1e9e8-5b", "ovs_interfaceid": "dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG os_vif [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdab1e9e8-5b, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2823bd1-0cc4-4ed7-a71a-2448854ed840) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:07 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:45:07 user nova-compute[74080]: INFO os_vif [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:fd:24,bridge_name='br-int',has_traffic_filtering=True,id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdab1e9e8-5b')
Oct 16 07:45:07 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Deleting instance files /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756_del
Oct 16 07:45:07 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Deletion of /opt/stack/data/nova/instances/d3e5e8b9-5b6f-446a-aabe-2944817a3756_del complete
Oct 16 07:45:08 user nova-compute[74080]: INFO nova.compute.manager [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 16 07:45:08 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:45:08 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:45:08 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:45:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:08 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:45:08 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Took 0.66 seconds to deallocate network for instance.
Oct 16 07:45:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-b65fd3e9-7179-4e18-9045-c3f68f873b0a req-403116b9-ff93-4a68-9bb3-684b5ebb110e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-deleted-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:08 user nova-compute[74080]: INFO nova.compute.manager [req-b65fd3e9-7179-4e18-9045-c3f68f873b0a req-403116b9-ff93-4a68-9bb3-684b5ebb110e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Neutron deleted interface dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3; detaching it from the instance and deleting it from the info cache
Oct 16 07:45:08 user nova-compute[74080]: DEBUG nova.network.neutron [req-b65fd3e9-7179-4e18-9045-c3f68f873b0a req-403116b9-ff93-4a68-9bb3-684b5ebb110e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:45:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-b65fd3e9-7179-4e18-9045-c3f68f873b0a req-403116b9-ff93-4a68-9bb3-684b5ebb110e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Detach interface failed, port_id=dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3, reason: Instance d3e5e8b9-5b6f-446a-aabe-2944817a3756 could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:45:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:09 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Deleted allocations for instance d3e5e8b9-5b6f-446a-aabe-2944817a3756
Oct 16 07:45:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38f65308-6663-47f0-828b-a56e9c40894c tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.332s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-655c63b0-696d-4b6d-9714-5ff71555ed7d req-7d93bd82-4bc1-48c5-9a2c-718b0636851e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-655c63b0-696d-4b6d-9714-5ff71555ed7d req-7d93bd82-4bc1-48c5-9a2c-718b0636851e service nova] Acquiring lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-655c63b0-696d-4b6d-9714-5ff71555ed7d req-7d93bd82-4bc1-48c5-9a2c-718b0636851e service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-655c63b0-696d-4b6d-9714-5ff71555ed7d req-7d93bd82-4bc1-48c5-9a2c-718b0636851e service nova] Lock "d3e5e8b9-5b6f-446a-aabe-2944817a3756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:09 user nova-compute[74080]: DEBUG nova.compute.manager [req-655c63b0-696d-4b6d-9714-5ff71555ed7d req-7d93bd82-4bc1-48c5-9a2c-718b0636851e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] No waiting events found dispatching network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:45:09 user nova-compute[74080]: WARNING nova.compute.manager [req-655c63b0-696d-4b6d-9714-5ff71555ed7d req-7d93bd82-4bc1-48c5-9a2c-718b0636851e service nova] [instance: d3e5e8b9-5b6f-446a-aabe-2944817a3756] Received unexpected event network-vif-plugged-dab1e9e8-5b06-4fdb-a3e7-78b0add8cbc3 for instance with vm_state deleted and task_state None.
Oct 16 07:45:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:14 user nova-compute[74080]: WARNING nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid dd394796-510c-4990-aaa7-7f479173c476 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 4d6118bf-0075-4d1c-ad47-c151722a4ad0 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid f0dd4404-980e-42a2-a008-05a90d9a5a05 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 5a35de85-4095-4a93-8d33-a4577b960b95 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid bc44f5cc-26d8-4ff2-a868-432143effed3 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 816158fd-6a77-4d53-9cdb-09707887bafe {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Triggering sync for uuid 06d935f9-585b-4d7b-aa6e-8bfe7085edd7 {{(pid=74080) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "dd394796-510c-4990-aaa7-7f479173c476" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "dd394796-510c-4990-aaa7-7f479173c476" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "f0dd4404-980e-42a2-a008-05a90d9a5a05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "5a35de85-4095-4a93-8d33-a4577b960b95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "5a35de85-4095-4a93-8d33-a4577b960b95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "bc44f5cc-26d8-4ff2-a868-432143effed3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "dd394796-510c-4990-aaa7-7f479173c476" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "4d6118bf-0075-4d1c-ad47-c151722a4ad0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "5a35de85-4095-4a93-8d33-a4577b960b95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "f0dd4404-980e-42a2-a008-05a90d9a5a05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "8a89c84b-8e61-4290-b4e6-fe1c2bc738e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.objects.instance [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'flavor' on Instance uuid bc44f5cc-26d8-4ff2-a868-432143effed3 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-30807688-dcef-409a-999d-50f1b4c06b39 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.098s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.205s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "bc44f5cc-26d8-4ff2-a868-432143effed3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:45:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Creating image(s)
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Ensure instance console log exists: /opt/stack/data/nova/instances/06d935f9-585b-4d7b-aa6e-8bfe7085edd7/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Start _get_guest_xml network_info=[{"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e1ac0d22-d75a-4ca7-b1db-4eecfd130f09', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URGJHYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06d935f9-585b-4d7b-aa6e-8bfe7085edd7', 'attached_at': '', 'detached_at': '', 'volume_id': '6abde53f-ca40-4805-89b6-7274eb9fad84', 'serial': '6abde53f-ca40-4805-89b6-7274eb9fad84'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:45:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:45:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URGJHYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:45:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:45:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:45:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:45:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:45:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:45:14 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:45:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d67307-3bb7-425f-89c5-21b2dfa9618b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:45:15 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e70eb7a-9464-43bf-826e-d5c780077705]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84] added
Oct 16 07:45:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b7cafb-8d20-40a5-89ea-40a148a95f8c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4b4a52-26ae-40a7-9791-e2f351bb32c3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URGJHYrh {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URGJHYrh" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f1500c-eacd-4d5d-8184-5d1e8da2f9dd]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URGJHYrh'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d59c21-def5-4703-895d-d328a9967457]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d4da2-0c5e-4514-975f-83265d44a716]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b217d0-3dd8-43fb-b175-3415e04f0932]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260]
Oct 16 07:45:15 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84, portal: 172.16.0.220,3260] successful.
Oct 16 07:45:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69e3d89-1869-4d8e-8e4b-1f0f4b2a41d0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85f6712-c448-4669-8ba9-a14c681e63f9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:45:15 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[901cf849-a7d8-4c5b-81ba-659237ed6896]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:45:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URGJHYrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23131303736346637', 'path': '/dev/sdc'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131303736346637', 'path': '/dev/sdc'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1677460809',display_name='tempest-TestVolumeBootPattern-server-1677460809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1677460809',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUB4evsnJY2sT1HccGkPebZAqVN/dVr0njmKk6++1K+M1J0EeXtYJ/VhykTTCYV6t+en05gMrUhPTd7ZZ42WU1pr/6VunsCqdc5GhfD3N/4gmeez4gK3GWGniO7CnDJQ==',key_name='tempest-TestVolumeBootPattern-975136939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-kj3lqs0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:44:58Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=06d935f9-585b-4d7b-aa6e-8bfe7085edd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7c:40,bridge_name='br-int',has_traffic_filtering=True,id=74baa473-bf01-4431-b89d-a2390dd766ac,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74baa473-bf') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'pci_devices' on Instance uuid 06d935f9-585b-4d7b-aa6e-8bfe7085edd7 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:45:16 user nova-compute[74080]:   <uuid>06d935f9-585b-4d7b-aa6e-8bfe7085edd7</uuid>
Oct 16 07:45:16 user nova-compute[74080]:   <name>instance-00000024</name>
Oct 16 07:45:16 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:45:16 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:45:16 user nova-compute[74080]:   <metadata>
Oct 16 07:45:16 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:45:16 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:45:16 user nova-compute[74080]:       <nova:name>tempest-TestVolumeBootPattern-server-1677460809</nova:name>
Oct 16 07:45:16 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:45:14</nova:creationTime>
Oct 16 07:45:16 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:45:16 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:45:16 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:45:16 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:45:16 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:45:16 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:45:16 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:45:16 user nova-compute[74080]:       <nova:owner>
Oct 16 07:45:16 user nova-compute[74080]:         <nova:user uuid="33b58ae309d047548ebf29684db6037e">tempest-TestVolumeBootPattern-959199453-project-member</nova:user>
Oct 16 07:45:16 user nova-compute[74080]:         <nova:project uuid="c8b70039a31c47f39f7bf1b01b4e6e79">tempest-TestVolumeBootPattern-959199453</nova:project>
Oct 16 07:45:16 user nova-compute[74080]:       </nova:owner>
Oct 16 07:45:16 user nova-compute[74080]:       <nova:ports>
Oct 16 07:45:16 user nova-compute[74080]:         <nova:port uuid="74baa473-bf01-4431-b89d-a2390dd766ac">
Oct 16 07:45:16 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 07:45:16 user nova-compute[74080]:         </nova:port>
Oct 16 07:45:16 user nova-compute[74080]:       </nova:ports>
Oct 16 07:45:16 user nova-compute[74080]:     </nova:instance>
Oct 16 07:45:16 user nova-compute[74080]:   </metadata>
Oct 16 07:45:16 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:45:16 user nova-compute[74080]:     <system>
Oct 16 07:45:16 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:45:16 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:45:16 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:45:16 user nova-compute[74080]:       <entry name="serial">06d935f9-585b-4d7b-aa6e-8bfe7085edd7</entry>
Oct 16 07:45:16 user nova-compute[74080]:       <entry name="uuid">06d935f9-585b-4d7b-aa6e-8bfe7085edd7</entry>
Oct 16 07:45:16 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:45:16 user nova-compute[74080]:     </system>
Oct 16 07:45:16 user nova-compute[74080]:   </sysinfo>
Oct 16 07:45:16 user nova-compute[74080]:   <os>
Oct 16 07:45:16 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:45:16 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:45:16 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:45:16 user nova-compute[74080]:   </os>
Oct 16 07:45:16 user nova-compute[74080]:   <features>
Oct 16 07:45:16 user nova-compute[74080]:     <acpi/>
Oct 16 07:45:16 user nova-compute[74080]:     <apic/>
Oct 16 07:45:16 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:45:16 user nova-compute[74080]:   </features>
Oct 16 07:45:16 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:45:16 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:45:16 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:45:16 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:45:16 user nova-compute[74080]:   </clock>
Oct 16 07:45:16 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:45:16 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:45:16 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:45:16 user nova-compute[74080]:   </cpu>
Oct 16 07:45:16 user nova-compute[74080]:   <devices>
Oct 16 07:45:16 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:45:16 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:45:16 user nova-compute[74080]:       <source dev="/dev/sdc"/>
Oct 16 07:45:16 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:45:16 user nova-compute[74080]:       <serial>6abde53f-ca40-4805-89b6-7274eb9fad84</serial>
Oct 16 07:45:16 user nova-compute[74080]:     </disk>
Oct 16 07:45:16 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:45:16 user nova-compute[74080]:       <mac address="fa:16:3e:35:7c:40"/>
Oct 16 07:45:16 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:45:16 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:45:16 user nova-compute[74080]:       <target dev="tap74baa473-bf"/>
Oct 16 07:45:16 user nova-compute[74080]:     </interface>
Oct 16 07:45:16 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:45:16 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/06d935f9-585b-4d7b-aa6e-8bfe7085edd7/console.log" append="off"/>
Oct 16 07:45:16 user nova-compute[74080]:     </serial>
Oct 16 07:45:16 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:45:16 user nova-compute[74080]:     <video>
Oct 16 07:45:16 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:45:16 user nova-compute[74080]:     </video>
Oct 16 07:45:16 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:45:16 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:45:16 user nova-compute[74080]:     </rng>
Oct 16 07:45:16 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:45:16 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:45:16 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:45:16 user nova-compute[74080]:     </memballoon>
Oct 16 07:45:16 user nova-compute[74080]:   </devices>
Oct 16 07:45:16 user nova-compute[74080]: </domain>
Oct 16 07:45:16 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:44:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1677460809',display_name='tempest-TestVolumeBootPattern-server-1677460809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1677460809',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUB4evsnJY2sT1HccGkPebZAqVN/dVr0njmKk6++1K+M1J0EeXtYJ/VhykTTCYV6t+en05gMrUhPTd7ZZ42WU1pr/6VunsCqdc5GhfD3N/4gmeez4gK3GWGniO7CnDJQ==',key_name='tempest-TestVolumeBootPattern-975136939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-kj3lqs0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:44:58Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=06d935f9-585b-4d7b-aa6e-8bfe7085edd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7c:40,bridge_name='br-int',has_traffic_filtering=True,id=74baa473-bf01-4431-b89d-a2390dd766ac,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74baa473-bf') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG os_vif [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7c:40,bridge_name='br-int',has_traffic_filtering=True,id=74baa473-bf01-4431-b89d-a2390dd766ac,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74baa473-bf') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f493c41a-660c-58ac-8dd3-7774bccbc83b', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74baa473-bf, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74baa473-bf, col_values=(('qos', UUID('1f54cd4f-952b-4e4b-9185-96c8e7aae7f2')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74baa473-bf, col_values=(('external_ids', {'iface-id': '74baa473-bf01-4431-b89d-a2390dd766ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:7c:40', 'vm-uuid': '06d935f9-585b-4d7b-aa6e-8bfe7085edd7'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:16 user nova-compute[74080]: INFO os_vif [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7c:40,bridge_name='br-int',has_traffic_filtering=True,id=74baa473-bf01-4431-b89d-a2390dd766ac,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74baa473-bf')
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:45:16 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No VIF found with MAC fa:16:3e:35:7c:40, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:45:17 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-3421a8c9-be3a-446f-925e-9d557c989217 req-e9373880-bd9e-43dc-b4dc-73e9a0534664 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Received event network-vif-plugged-74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3421a8c9-be3a-446f-925e-9d557c989217 req-e9373880-bd9e-43dc-b4dc-73e9a0534664 service nova] Acquiring lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3421a8c9-be3a-446f-925e-9d557c989217 req-e9373880-bd9e-43dc-b4dc-73e9a0534664 service nova] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3421a8c9-be3a-446f-925e-9d557c989217 req-e9373880-bd9e-43dc-b4dc-73e9a0534664 service nova] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG nova.compute.manager [req-3421a8c9-be3a-446f-925e-9d557c989217 req-e9373880-bd9e-43dc-b4dc-73e9a0534664 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] No waiting events found dispatching network-vif-plugged-74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:45:18 user nova-compute[74080]: WARNING nova.compute.manager [req-3421a8c9-be3a-446f-925e-9d557c989217 req-e9373880-bd9e-43dc-b4dc-73e9a0534664 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Received unexpected event network-vif-plugged-74baa473-bf01-4431-b89d-a2390dd766ac for instance with vm_state building and task_state spawning.
Oct 16 07:45:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Didn't find any instances for network info cache update. {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:45:19 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Instance spawned successfully.
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:20 user nova-compute[74080]: INFO nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 16 07:45:20 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:45:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-7e1d0557-6c19-49e1-b3f1-972df4a1c832 req-a775e10a-0f8f-45c3-a166-eb0af0d78911 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Received event network-vif-plugged-74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e1d0557-6c19-49e1-b3f1-972df4a1c832 req-a775e10a-0f8f-45c3-a166-eb0af0d78911 service nova] Acquiring lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e1d0557-6c19-49e1-b3f1-972df4a1c832 req-a775e10a-0f8f-45c3-a166-eb0af0d78911 service nova] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7e1d0557-6c19-49e1-b3f1-972df4a1c832 req-a775e10a-0f8f-45c3-a166-eb0af0d78911 service nova] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:20 user nova-compute[74080]: DEBUG nova.compute.manager [req-7e1d0557-6c19-49e1-b3f1-972df4a1c832 req-a775e10a-0f8f-45c3-a166-eb0af0d78911 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] No waiting events found dispatching network-vif-plugged-74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:45:20 user nova-compute[74080]: WARNING nova.compute.manager [req-7e1d0557-6c19-49e1-b3f1-972df4a1c832 req-a775e10a-0f8f-45c3-a166-eb0af0d78911 service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Received unexpected event network-vif-plugged-74baa473-bf01-4431-b89d-a2390dd766ac for instance with vm_state building and task_state spawning.
Oct 16 07:45:20 user nova-compute[74080]: INFO nova.compute.manager [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Took 23.63 seconds to build instance.
Oct 16 07:45:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6d842a0d-248c-43a5-8019-ec2677126814 tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.750s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.023s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:20 user nova-compute[74080]: INFO nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 16 07:45:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "06d935f9-585b-4d7b-aa6e-8bfe7085edd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:45:22 user nova-compute[74080]: INFO nova.compute.claims [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Claim successful on node user
Oct 16 07:45:22 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Refreshing inventories for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Updating ProviderTree inventory for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Updating inventory in ProviderTree for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Refreshing aggregate associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, aggregates: None {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 07:45:22 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Refreshing trait associations for resource provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41 {{(pid=74080) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:45:23 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.policy [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8537fd36ebd340b09c830ab09cd16d0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '479d15d0c8ae430096c24dd442ce1e78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:45:23 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Creating image(s)
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.212s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk 1073741824" returned: 0 in 0.059s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:23 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.221s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Successfully created port: 4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Cannot resize image /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Ensure instance console log exists: /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Successfully updated port: 4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquired lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:45:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-changed-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.compute.manager [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Refreshing instance network info cache due to event network-changed-4a6b5e9d-7a95-40e7-b890-e9500d69d682. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] Acquiring lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.neutron [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Updating instance_info_cache with network_info: [{"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Releasing lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Instance network_info: |[{"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] Acquired lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.neutron [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Refreshing network info cache for port 4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Start _get_guest_xml network_info=[{"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:45:25 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:45:25 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-966016608',display_name='tempest-ServerRescueNegativeTestJSON-server-966016608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-966016608',id=37,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdWYdtzD+DEQgPRArLmWf9SI9GZKa/RcWI7z9dbPjSF2CXDaxlHR2Qii5q/e4gcUzCI2drUtCgzUJz4iwfojYeH0rUx6NHJcnyL9RnwtyfDhCxzW9EAkOcbSMK27S25yA==',key_name='tempest-keypair-411109809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-nwqii3xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:45:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=fa351f45-3a41-4f50-b38e-62c8a5bacbdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ce:e4,bridge_name='br-int',has_traffic_filtering=True,id=4a6b5e9d-7a95-40e7-b890-e9500d69d682,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6b5e9d-7a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.objects.instance [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'pci_devices' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:45:25 user nova-compute[74080]:   <uuid>fa351f45-3a41-4f50-b38e-62c8a5bacbdd</uuid>
Oct 16 07:45:25 user nova-compute[74080]:   <name>instance-00000025</name>
Oct 16 07:45:25 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:45:25 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:45:25 user nova-compute[74080]:   <metadata>
Oct 16 07:45:25 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:45:25 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:45:25 user nova-compute[74080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-966016608</nova:name>
Oct 16 07:45:25 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:45:25</nova:creationTime>
Oct 16 07:45:25 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:45:25 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:45:25 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:45:25 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:45:25 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:45:25 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:45:25 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:45:25 user nova-compute[74080]:       <nova:owner>
Oct 16 07:45:25 user nova-compute[74080]:         <nova:user uuid="8537fd36ebd340b09c830ab09cd16d0b">tempest-ServerRescueNegativeTestJSON-2029305131-project-member</nova:user>
Oct 16 07:45:25 user nova-compute[74080]:         <nova:project uuid="479d15d0c8ae430096c24dd442ce1e78">tempest-ServerRescueNegativeTestJSON-2029305131</nova:project>
Oct 16 07:45:25 user nova-compute[74080]:       </nova:owner>
Oct 16 07:45:25 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:45:25 user nova-compute[74080]:       <nova:ports>
Oct 16 07:45:25 user nova-compute[74080]:         <nova:port uuid="4a6b5e9d-7a95-40e7-b890-e9500d69d682">
Oct 16 07:45:25 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 07:45:25 user nova-compute[74080]:         </nova:port>
Oct 16 07:45:25 user nova-compute[74080]:       </nova:ports>
Oct 16 07:45:25 user nova-compute[74080]:     </nova:instance>
Oct 16 07:45:25 user nova-compute[74080]:   </metadata>
Oct 16 07:45:25 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:45:25 user nova-compute[74080]:     <system>
Oct 16 07:45:25 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:45:25 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:45:25 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:45:25 user nova-compute[74080]:       <entry name="serial">fa351f45-3a41-4f50-b38e-62c8a5bacbdd</entry>
Oct 16 07:45:25 user nova-compute[74080]:       <entry name="uuid">fa351f45-3a41-4f50-b38e-62c8a5bacbdd</entry>
Oct 16 07:45:25 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:45:25 user nova-compute[74080]:     </system>
Oct 16 07:45:25 user nova-compute[74080]:   </sysinfo>
Oct 16 07:45:25 user nova-compute[74080]:   <os>
Oct 16 07:45:25 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:45:25 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:45:25 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:45:25 user nova-compute[74080]:   </os>
Oct 16 07:45:25 user nova-compute[74080]:   <features>
Oct 16 07:45:25 user nova-compute[74080]:     <acpi/>
Oct 16 07:45:25 user nova-compute[74080]:     <apic/>
Oct 16 07:45:25 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:45:25 user nova-compute[74080]:   </features>
Oct 16 07:45:25 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:45:25 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:45:25 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:45:25 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:45:25 user nova-compute[74080]:   </clock>
Oct 16 07:45:25 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:45:25 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:45:25 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:45:25 user nova-compute[74080]:   </cpu>
Oct 16 07:45:25 user nova-compute[74080]:   <devices>
Oct 16 07:45:25 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:45:25 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:45:25 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk"/>
Oct 16 07:45:25 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:45:25 user nova-compute[74080]:     </disk>
Oct 16 07:45:25 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:45:25 user nova-compute[74080]:       <mac address="fa:16:3e:b6:ce:e4"/>
Oct 16 07:45:25 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:45:25 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:45:25 user nova-compute[74080]:       <target dev="tap4a6b5e9d-7a"/>
Oct 16 07:45:25 user nova-compute[74080]:     </interface>
Oct 16 07:45:25 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:45:25 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/console.log" append="off"/>
Oct 16 07:45:25 user nova-compute[74080]:     </serial>
Oct 16 07:45:25 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:45:25 user nova-compute[74080]:     <video>
Oct 16 07:45:25 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:45:25 user nova-compute[74080]:     </video>
Oct 16 07:45:25 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:45:25 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:45:25 user nova-compute[74080]:     </rng>
Oct 16 07:45:25 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:45:25 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:45:25 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:45:25 user nova-compute[74080]:     </memballoon>
Oct 16 07:45:25 user nova-compute[74080]:   </devices>
Oct 16 07:45:25 user nova-compute[74080]: </domain>
Oct 16 07:45:25 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-966016608',display_name='tempest-ServerRescueNegativeTestJSON-server-966016608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-966016608',id=37,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdWYdtzD+DEQgPRArLmWf9SI9GZKa/RcWI7z9dbPjSF2CXDaxlHR2Qii5q/e4gcUzCI2drUtCgzUJz4iwfojYeH0rUx6NHJcnyL9RnwtyfDhCxzW9EAkOcbSMK27S25yA==',key_name='tempest-keypair-411109809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-nwqii3xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:45:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=fa351f45-3a41-4f50-b38e-62c8a5bacbdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ce:e4,bridge_name='br-int',has_traffic_filtering=True,id=4a6b5e9d-7a95-40e7-b890-e9500d69d682,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6b5e9d-7a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG os_vif [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ce:e4,bridge_name='br-int',has_traffic_filtering=True,id=4a6b5e9d-7a95-40e7-b890-e9500d69d682,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6b5e9d-7a') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '410c7c2c-a7a6-53e1-adda-3eb629da6bbd', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a6b5e9d-7a, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a6b5e9d-7a, col_values=(('qos', UUID('fc5efc68-8f86-4256-8e8e-89c5bd3fe394')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a6b5e9d-7a, col_values=(('external_ids', {'iface-id': '4a6b5e9d-7a95-40e7-b890-e9500d69d682', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ce:e4', 'vm-uuid': 'fa351f45-3a41-4f50-b38e-62c8a5bacbdd'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:25 user nova-compute[74080]: INFO os_vif [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ce:e4,bridge_name='br-int',has_traffic_filtering=True,id=4a6b5e9d-7a95-40e7-b890-e9500d69d682,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6b5e9d-7a')
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No VIF found with MAC fa:16:3e:b6:ce:e4, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.neutron [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Updated VIF entry in instance network info cache for port 4a6b5e9d-7a95-40e7-b890-e9500d69d682. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG nova.network.neutron [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Updating instance_info_cache with network_info: [{"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:45:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-009a5f94-dfdd-4ec0-8ba6-5fc5fa1a3d88 req-15f5ca5f-497f-4476-90c2-74604a3f1bd0 service nova] Releasing lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:45:26 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:26 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4455963-9d87-4502-bdd4-0c3e09cd3bba req-b5d56a41-5db2-49fd-9f41-ac9e83f3f9fd service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4455963-9d87-4502-bdd4-0c3e09cd3bba req-b5d56a41-5db2-49fd-9f41-ac9e83f3f9fd service nova] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4455963-9d87-4502-bdd4-0c3e09cd3bba req-b5d56a41-5db2-49fd-9f41-ac9e83f3f9fd service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e4455963-9d87-4502-bdd4-0c3e09cd3bba req-b5d56a41-5db2-49fd-9f41-ac9e83f3f9fd service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-e4455963-9d87-4502-bdd4-0c3e09cd3bba req-b5d56a41-5db2-49fd-9f41-ac9e83f3f9fd service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] No waiting events found dispatching network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:45:27 user nova-compute[74080]: WARNING nova.compute.manager [req-e4455963-9d87-4502-bdd4-0c3e09cd3bba req-b5d56a41-5db2-49fd-9f41-ac9e83f3f9fd service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received unexpected event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 for instance with vm_state building and task_state spawning.
Oct 16 07:45:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:45:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-5db99474-39ad-481a-8dd0-f7f93ffd4804 req-9ab47b60-08d9-4e77-a78b-23b3f11a6c7f service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5db99474-39ad-481a-8dd0-f7f93ffd4804 req-9ab47b60-08d9-4e77-a78b-23b3f11a6c7f service nova] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5db99474-39ad-481a-8dd0-f7f93ffd4804 req-9ab47b60-08d9-4e77-a78b-23b3f11a6c7f service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5db99474-39ad-481a-8dd0-f7f93ffd4804 req-9ab47b60-08d9-4e77-a78b-23b3f11a6c7f service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-5db99474-39ad-481a-8dd0-f7f93ffd4804 req-9ab47b60-08d9-4e77-a78b-23b3f11a6c7f service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] No waiting events found dispatching network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:45:29 user nova-compute[74080]: WARNING nova.compute.manager [req-5db99474-39ad-481a-8dd0-f7f93ffd4804 req-9ab47b60-08d9-4e77-a78b-23b3f11a6c7f service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received unexpected event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 for instance with vm_state building and task_state spawning.
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:45:29 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Instance spawned successfully.
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:45:29 user nova-compute[74080]: INFO nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Took 6.01 seconds to spawn the instance on the hypervisor.
Oct 16 07:45:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:29 user nova-compute[74080]: INFO nova.compute.manager [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Took 7.32 seconds to build instance.
Oct 16 07:45:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-fe929ffc-f212-43dc-a33a-3f441ddb4ea6 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.442s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:35 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:45:35 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7271MB free_disk=24.89957046508789GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance bc44f5cc-26d8-4ff2-a868-432143effed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 816158fd-6a77-4d53-9cdb-09707887bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 06d935f9-585b-4d7b-aa6e-8bfe7085edd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance fa351f45-3a41-4f50-b38e-62c8a5bacbdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:35 user nova-compute[74080]: DEBUG nova.objects.instance [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'flavor' on Instance uuid 816158fd-6a77-4d53-9cdb-09707887bafe {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:45:36 user nova-compute[74080]: INFO nova.compute.manager [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Attaching volume 29473c7b-f697-4e14-8109-cf169fd7de33 to /dev/vdb
Oct 16 07:45:36 user nova-compute[74080]: DEBUG os_brick.utils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[99822e5c-cc53-4b4e-86d3-684c73105bc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb317617-2cf6-4099-bc11-b7ef1883d96e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcd0db9-f30e-44e7-b521-dc3ef3d5af00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5432d907-38e4-412f-881c-f2cf8266e30e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:45:36 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:45:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[906113e2-495c-491f-ad90-252daa8f4a1f]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG os_brick.utils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:45:36 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating existing volume attachment record: 1829b234-22e7-45dc-80b3-da955c8e438d {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:45:37 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:37 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:45:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oruEazCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:45:51 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:45:51 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:45:51 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ffdc0e-707f-4c91-ae84-c35e5eb713e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:45:51 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d6ac01-3bd2-453a-9a13-e89d57d607f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33] added
Oct 16 07:45:51 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e70816-8fed-46cc-8a24-b87e60ae4389]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf418d-9d92-4016-b201-0b55616c6915]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oruEazCJ {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oruEazCJ" returned: 0 in 0.082s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e3e0f1-4427-4db1-ac29-d8838de8308c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oruEazCJ'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:51 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2024d4a-10c8-4f40-80a2-4427cd739a7c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4cd3a6-f8aa-456f-89d6-2d9124e5bf76]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2440180-6b17-46c6-88da-d025e7cac0f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260]
Oct 16 07:45:52 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260] successful.
Oct 16 07:45:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da689c-a01c-4999-a651-3488571b8000]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f488dc74-9d0c-4c77-8398-6842718744e1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:45:52 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a2b2c2-95e7-4175-bbfd-22224d95f9d0]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:45:52 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oruEazCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '26365376332383839', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365376332383839', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG nova.objects.instance [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'flavor' on Instance uuid 816158fd-6a77-4d53-9cdb-09707887bafe {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:45:53 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:45:53 user nova-compute[74080]:   <source dev="/dev/sdd"/>
Oct 16 07:45:53 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:45:53 user nova-compute[74080]:   <serial>29473c7b-f697-4e14-8109-cf169fd7de33</serial>
Oct 16 07:45:53 user nova-compute[74080]: </disk>
Oct 16 07:45:53 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG nova.compute.manager [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:45:53 user nova-compute[74080]: INFO nova.compute.manager [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] instance snapshotting
Oct 16 07:45:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:45:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] No VIF found with MAC fa:16:3e:eb:37:6e, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:45:53 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Beginning live snapshot process
Oct 16 07:45:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-235f2906-2c09-4230-af66-494e90677451 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.724s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpys6q_mrx/f567b0cfb052446694f5a1108a0c6056.delta 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:54 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpys6q_mrx/f567b0cfb052446694f5a1108a0c6056.delta 1073741824" returned: 0 in 0.055s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:54 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 07:45:55 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:45:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:45:55 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] COPY block job progress, current cursor: 23199744 final cursor: 75563008 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:45:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:45:56 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 07:45:56 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:45:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpys6q_mrx/f567b0cfb052446694f5a1108a0c6056.delta /opt/stack/data/nova/instances/snapshots/tmpys6q_mrx/f567b0cfb052446694f5a1108a0c6056 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:45:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:45:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing instance network info cache due to event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:45:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] Acquiring lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:45:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] Acquired lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:45:56 user nova-compute[74080]: DEBUG nova.network.neutron [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:45:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpys6q_mrx/f567b0cfb052446694f5a1108a0c6056.delta /opt/stack/data/nova/instances/snapshots/tmpys6q_mrx/f567b0cfb052446694f5a1108a0c6056" returned: 0 in 0.567s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:45:57 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Snapshot extracted, beginning image upload
Oct 16 07:45:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updated VIF entry in instance network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:45:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating instance_info_cache with network_info: [{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:45:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-f3df306a-e88f-49e4-92c2-4d300d6a4fcf req-5d85abec-e134-41be-a23b-0277669b739e service nova] Releasing lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:45:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:00 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Snapshot image upload complete
Oct 16 07:46:00 user nova-compute[74080]: INFO nova.compute.manager [None req-989f2009-56bb-4588-b438-cd98fd9f34d1 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: bc44f5cc-26d8-4ff2-a868-432143effed3] Took 6.75 seconds to snapshot the instance on the hypervisor.
Oct 16 07:46:00 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-changed-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Refreshing instance network info cache due to event network-changed-6310f7ae-bb5b-4bcb-9eff-e1c20483e948. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] Acquiring lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] Acquired lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG nova.network.neutron [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Refreshing network info cache for port 6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG nova.compute.manager [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing instance network info cache due to event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] Acquiring lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] Acquired lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:01 user nova-compute[74080]: DEBUG nova.network.neutron [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:02 user nova-compute[74080]: INFO nova.compute.manager [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Rebooting instance
Oct 16 07:46:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updated VIF entry in instance network info cache for port 6310f7ae-bb5b-4bcb-9eff-e1c20483e948. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updating instance_info_cache with network_info: [{"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e589af71-1bd3-4f25-a836-f0d955cd7960 req-de0d4352-9145-442d-a36f-d8685164a73c service nova] Releasing lock "refresh_cache-99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updated VIF entry in instance network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG nova.network.neutron [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating instance_info_cache with network_info: [{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b1b93beb-3bd4-4765-9dde-aa5915980a19 req-c33f030a-8409-431c-81dc-f0d663347624 service nova] Releasing lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquired lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:02 user nova-compute[74080]: DEBUG nova.network.neutron [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG nova.network.neutron [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating instance_info_cache with network_info: [{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Releasing lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG nova.compute.manager [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "90178686-25e3-4659-8c41-adbc6fb83d63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "90178686-25e3-4659-8c41-adbc6fb83d63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "7b61eeb2-de2e-498d-b307-852473aadb01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:46:03 user nova-compute[74080]: INFO nova.compute.claims [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Claim successful on node user
Oct 16 07:46:03 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:46:03 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.526s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:46:04 user nova-compute[74080]: INFO nova.compute.claims [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Claim successful on node user
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:46:04 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:46:04 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Creating image(s)
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "/opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "/opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "/opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.274s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.policy [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db721d9235c64087bf54998e468b7f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb49371c30764797a229c88006622241', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk 1073741824" returned: 0 in 0.070s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG nova.network.neutron [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:04 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:04 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:46:05 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG nova.policy [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e86c6830d51c45f78230b6231ff26e2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be593890c024a4bac126c56f5fa8468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.198s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk. size=1073741824 {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:46:05 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Creating image(s)
Oct 16 07:46:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "/opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "/opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "d55d3db3b85c009cd6066b2e7dc36563acb1bc05" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:05 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "d55d3db3b85c009cd6066b2e7dc36563acb1bc05" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.part --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Successfully created port: b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-32fce811-5962-43f5-b669-67311bda9ec9 req-53cd4c1f-b044-43e0-983d-27cbaeb1017e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-vif-unplugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32fce811-5962-43f5-b669-67311bda9ec9 req-53cd4c1f-b044-43e0-983d-27cbaeb1017e service nova] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32fce811-5962-43f5-b669-67311bda9ec9 req-53cd4c1f-b044-43e0-983d-27cbaeb1017e service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-32fce811-5962-43f5-b669-67311bda9ec9 req-53cd4c1f-b044-43e0-983d-27cbaeb1017e service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.compute.manager [req-32fce811-5962-43f5-b669-67311bda9ec9 req-53cd4c1f-b044-43e0-983d-27cbaeb1017e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] No waiting events found dispatching network-vif-unplugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:06 user nova-compute[74080]: WARNING nova.compute.manager [req-32fce811-5962-43f5-b669-67311bda9ec9 req-53cd4c1f-b044-43e0-983d-27cbaeb1017e service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received unexpected event network-vif-unplugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb for instance with vm_state active and task_state reboot_started.
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json" returned: 0 in 1.250s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.network.neutron [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Successfully created port: 4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.virt.disk.api [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Cannot resize image /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk to a smaller size. {{(pid=74080) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Ensure instance console log exists: /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.part --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.virt.images [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] c54f4e59-7872-4e68-9569-9b8d19e6268d was qcow2, converting to raw {{(pid=74080) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.part /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.converted {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:06 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Instance shutdown successfully.
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.part /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.converted" returned: 0 in 0.290s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:06 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.converted --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "d55d3db3b85c009cd6066b2e7dc36563acb1bc05" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.820s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05 --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "d55d3db3b85c009cd6066b2e7dc36563acb1bc05" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "d55d3db3b85c009cd6066b2e7dc36563acb1bc05" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05 --force-share --output=json" returned: 0 in 0.222s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05,backing_fmt=raw /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05,backing_fmt=raw /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk 1073741824" returned: 0 in 0.052s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "d55d3db3b85c009cd6066b2e7dc36563acb1bc05" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05 --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.network.neutron [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Successfully updated port: 4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Successfully updated port: b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:07 user nova-compute[74080]: INFO nova.compute.manager [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Attaching volume 30bf0ffc-bb44-4066-8d99-6210af53c01a to /dev/vdb
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquired lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquired lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.network.neutron [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55d3db3b85c009cd6066b2e7dc36563acb1bc05 --force-share --output=json" returned: 0 in 0.189s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Ensure instance console log exists: /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG os_brick.utils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.network.neutron [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4c7e5-68cd-486c-af7f-314dbfcb4a99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1b7ef6-4293-45e2-92fb-226932ba4eed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f037a44b-2ad1-42e1-aeb9-9b2866ecc62a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[067eeb36-7782-4e87-94bf-63defafcfbd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:46:07 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:46:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fc2fe0-3f95-4314-b445-373c770c3143]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG os_brick.utils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:46:07 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updating existing volume attachment record: d96a3be7-15be-4830-91da-2acda7cde1c5 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.neutron [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Updating instance_info_cache with network_info: [{"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Releasing lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Instance network_info: |[{"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Start _get_guest_xml network_info=[{"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6e9001385f68e1499d3de5439a8ab89b',container_format='bare',created_at=2023-10-16T07:45:53Z,direct_url=<?>,disk_format='qcow2',id=c54f4e59-7872-4e68-9569-9b8d19e6268d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-336414657',owner='0be593890c024a4bac126c56f5fa8468',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T07:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'c54f4e59-7872-4e68-9569-9b8d19e6268d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:46:08 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:46:08 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6e9001385f68e1499d3de5439a8ab89b',container_format='bare',created_at=2023-10-16T07:45:53Z,direct_url=<?>,disk_format='qcow2',id=c54f4e59-7872-4e68-9569-9b8d19e6268d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-336414657',owner='0be593890c024a4bac126c56f5fa8468',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T07:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2109712353',display_name='tempest-TestStampPattern-server-2109712353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2109712353',id=39,image_ref='c54f4e59-7872-4e68-9569-9b8d19e6268d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm3HclZxeYbAP5crglnBUnTQN7eMThaBG71ykXZQEsaXymaDC/W4HEf1ef0XgIFZRepCi9jiVkrLYXNRaWHJaCx2nxCrB20XK08LGe33Iw28+NZHPGS84p3WPtdNdvlxQ==',key_name='tempest-TestStampPattern-419867254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0be593890c024a4bac126c56f5fa8468',ramdisk_id='',reservation_id='r-62cgz207',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bc44f5cc-26d8-4ff2-a868-432143effed3',image_min_disk='1',image_min_ram='0',image_owner_id='0be593890c024a4bac126c56f5fa8468',image_owner_project_name='tempest-TestStampPattern-39302602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-39302602-project-member',image_user_id='e86c6830d51c45f78230b6231ff26e2a',network_allocated='True',owner_project_name='tempest-TestStampPattern-39302602',owner_user_name='tempest-TestStampPattern-39302602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:46:05Z,user_data=None,user_id='e86c6830d51c45f78230b6231ff26e2a',uuid=7b61eeb2-de2e-498d-b307-852473aadb01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converting VIF {"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:72:b6,bridge_name='br-int',has_traffic_filtering=True,id=4263b4f4-8cc3-43ff-9df6-f1af111a7e63,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4263b4f4-8c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.objects.instance [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b61eeb2-de2e-498d-b307-852473aadb01 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:46:08 user nova-compute[74080]:   <uuid>7b61eeb2-de2e-498d-b307-852473aadb01</uuid>
Oct 16 07:46:08 user nova-compute[74080]:   <name>instance-00000027</name>
Oct 16 07:46:08 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:46:08 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:46:08 user nova-compute[74080]:   <metadata>
Oct 16 07:46:08 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:46:08 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:name>tempest-TestStampPattern-server-2109712353</nova:name>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:46:08</nova:creationTime>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:46:08 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:46:08 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:owner>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:user uuid="e86c6830d51c45f78230b6231ff26e2a">tempest-TestStampPattern-39302602-project-member</nova:user>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:project uuid="0be593890c024a4bac126c56f5fa8468">tempest-TestStampPattern-39302602</nova:project>
Oct 16 07:46:08 user nova-compute[74080]:       </nova:owner>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:root type="image" uuid="c54f4e59-7872-4e68-9569-9b8d19e6268d"/>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:ports>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:port uuid="4263b4f4-8cc3-43ff-9df6-f1af111a7e63">
Oct 16 07:46:08 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 07:46:08 user nova-compute[74080]:         </nova:port>
Oct 16 07:46:08 user nova-compute[74080]:       </nova:ports>
Oct 16 07:46:08 user nova-compute[74080]:     </nova:instance>
Oct 16 07:46:08 user nova-compute[74080]:   </metadata>
Oct 16 07:46:08 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:46:08 user nova-compute[74080]:     <system>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="serial">7b61eeb2-de2e-498d-b307-852473aadb01</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="uuid">7b61eeb2-de2e-498d-b307-852473aadb01</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:46:08 user nova-compute[74080]:     </system>
Oct 16 07:46:08 user nova-compute[74080]:   </sysinfo>
Oct 16 07:46:08 user nova-compute[74080]:   <os>
Oct 16 07:46:08 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:46:08 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:46:08 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:46:08 user nova-compute[74080]:   </os>
Oct 16 07:46:08 user nova-compute[74080]:   <features>
Oct 16 07:46:08 user nova-compute[74080]:     <acpi/>
Oct 16 07:46:08 user nova-compute[74080]:     <apic/>
Oct 16 07:46:08 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:46:08 user nova-compute[74080]:   </features>
Oct 16 07:46:08 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:46:08 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:46:08 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:46:08 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:46:08 user nova-compute[74080]:   </clock>
Oct 16 07:46:08 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:46:08 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:46:08 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:46:08 user nova-compute[74080]:   </cpu>
Oct 16 07:46:08 user nova-compute[74080]:   <devices>
Oct 16 07:46:08 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:46:08 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:46:08 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk"/>
Oct 16 07:46:08 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:46:08 user nova-compute[74080]:     </disk>
Oct 16 07:46:08 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:46:08 user nova-compute[74080]:       <mac address="fa:16:3e:ad:72:b6"/>
Oct 16 07:46:08 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:46:08 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:46:08 user nova-compute[74080]:       <target dev="tap4263b4f4-8c"/>
Oct 16 07:46:08 user nova-compute[74080]:     </interface>
Oct 16 07:46:08 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:46:08 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/console.log" append="off"/>
Oct 16 07:46:08 user nova-compute[74080]:     </serial>
Oct 16 07:46:08 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:46:08 user nova-compute[74080]:     <video>
Oct 16 07:46:08 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:46:08 user nova-compute[74080]:     </video>
Oct 16 07:46:08 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:46:08 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:46:08 user nova-compute[74080]:     </rng>
Oct 16 07:46:08 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:46:08 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:46:08 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:46:08 user nova-compute[74080]:     </memballoon>
Oct 16 07:46:08 user nova-compute[74080]:   </devices>
Oct 16 07:46:08 user nova-compute[74080]: </domain>
Oct 16 07:46:08 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2109712353',display_name='tempest-TestStampPattern-server-2109712353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2109712353',id=39,image_ref='c54f4e59-7872-4e68-9569-9b8d19e6268d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm3HclZxeYbAP5crglnBUnTQN7eMThaBG71ykXZQEsaXymaDC/W4HEf1ef0XgIFZRepCi9jiVkrLYXNRaWHJaCx2nxCrB20XK08LGe33Iw28+NZHPGS84p3WPtdNdvlxQ==',key_name='tempest-TestStampPattern-419867254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0be593890c024a4bac126c56f5fa8468',ramdisk_id='',reservation_id='r-62cgz207',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='bc44f5cc-26d8-4ff2-a868-432143effed3',image_min_disk='1',image_min_ram='0',image_owner_id='0be593890c024a4bac126c56f5fa8468',image_owner_project_name='tempest-TestStampPattern-39302602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-39302602-project-member',image_user_id='e86c6830d51c45f78230b6231ff26e2a',network_allocated='True',owner_project_name='tempest-TestStampPattern-39302602',owner_user_name='tempest-TestStampPattern-39302602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:46:05Z,user_data=None,user_id='e86c6830d51c45f78230b6231ff26e2a',uuid=7b61eeb2-de2e-498d-b307-852473aadb01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converting VIF {"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:72:b6,bridge_name='br-int',has_traffic_filtering=True,id=4263b4f4-8cc3-43ff-9df6-f1af111a7e63,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4263b4f4-8c') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG os_vif [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:72:b6,bridge_name='br-int',has_traffic_filtering=True,id=4263b4f4-8cc3-43ff-9df6-f1af111a7e63,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4263b4f4-8c') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updating instance_info_cache with network_info: [{"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65f04ba6-567e-522a-a9e1-218e7f7d13e7', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] No waiting events found dispatching network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:08 user nova-compute[74080]: WARNING nova.compute.manager [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received unexpected event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb for instance with vm_state active and task_state reboot_started.
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Received event network-changed-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Refreshing instance network info cache due to event network-changed-4263b4f4-8cc3-43ff-9df6-f1af111a7e63. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Acquiring lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Acquired lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.neutron [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Refreshing network info cache for port 4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Releasing lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Instance network_info: |[{"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Start _get_guest_xml network_info=[{"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'device_name': '/dev/vda', 'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4263b4f4-8c, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4263b4f4-8c, col_values=(('qos', UUID('cc9fb357-df4b-4a89-957b-9d67e20e74c4')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4263b4f4-8c, col_values=(('external_ids', {'iface-id': '4263b4f4-8cc3-43ff-9df6-f1af111a7e63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:72:b6', 'vm-uuid': '7b61eeb2-de2e-498d-b307-852473aadb01'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: INFO os_vif [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:72:b6,bridge_name='br-int',has_traffic_filtering=True,id=4263b4f4-8cc3-43ff-9df6-f1af111a7e63,network=Network(14fc4b49-2409-48da-b1d2-9e3a5df62aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4263b4f4-8c')
Oct 16 07:46:08 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:46:08 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-679793859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-679793859',id=38,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWhxkfuu6xvJnghzRZZ737A58JYsbtQCHTfH+owxrpU2wVCtryw1Bksx0dTRzVL+XxNM6plAQdbhKP0b5MjEX3WcblJXq8dA9PFStrdse3MAMWNS23NlkOCJ+39ghO5UA==',key_name='tempest-keypair-305204350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-ioghq4po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=90178686-25e3-4659-8c41-adbc6fb83d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=b07683df-b70a-4078-a943-b84cf8923016,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07683df-b7') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'pci_devices' on Instance uuid 90178686-25e3-4659-8c41-adbc6fb83d63 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:46:08 user nova-compute[74080]:   <uuid>90178686-25e3-4659-8c41-adbc6fb83d63</uuid>
Oct 16 07:46:08 user nova-compute[74080]:   <name>instance-00000026</name>
Oct 16 07:46:08 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:46:08 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:46:08 user nova-compute[74080]:   <metadata>
Oct 16 07:46:08 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:46:08 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-679793859</nova:name>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:46:08</nova:creationTime>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:46:08 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:46:08 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:owner>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:user uuid="db721d9235c64087bf54998e468b7f3e">tempest-AttachVolumeShelveTestJSON-2100146647-project-member</nova:user>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:project uuid="cb49371c30764797a229c88006622241">tempest-AttachVolumeShelveTestJSON-2100146647</nova:project>
Oct 16 07:46:08 user nova-compute[74080]:       </nova:owner>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:46:08 user nova-compute[74080]:       <nova:ports>
Oct 16 07:46:08 user nova-compute[74080]:         <nova:port uuid="b07683df-b70a-4078-a943-b84cf8923016">
Oct 16 07:46:08 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 07:46:08 user nova-compute[74080]:         </nova:port>
Oct 16 07:46:08 user nova-compute[74080]:       </nova:ports>
Oct 16 07:46:08 user nova-compute[74080]:     </nova:instance>
Oct 16 07:46:08 user nova-compute[74080]:   </metadata>
Oct 16 07:46:08 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:46:08 user nova-compute[74080]:     <system>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="serial">90178686-25e3-4659-8c41-adbc6fb83d63</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="uuid">90178686-25e3-4659-8c41-adbc6fb83d63</entry>
Oct 16 07:46:08 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:46:08 user nova-compute[74080]:     </system>
Oct 16 07:46:08 user nova-compute[74080]:   </sysinfo>
Oct 16 07:46:08 user nova-compute[74080]:   <os>
Oct 16 07:46:08 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:46:08 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:46:08 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:46:08 user nova-compute[74080]:   </os>
Oct 16 07:46:08 user nova-compute[74080]:   <features>
Oct 16 07:46:08 user nova-compute[74080]:     <acpi/>
Oct 16 07:46:08 user nova-compute[74080]:     <apic/>
Oct 16 07:46:08 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:46:08 user nova-compute[74080]:   </features>
Oct 16 07:46:08 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:46:08 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:46:08 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:46:08 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:46:08 user nova-compute[74080]:   </clock>
Oct 16 07:46:08 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:46:08 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:46:08 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:46:08 user nova-compute[74080]:   </cpu>
Oct 16 07:46:08 user nova-compute[74080]:   <devices>
Oct 16 07:46:08 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:46:08 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:46:08 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk"/>
Oct 16 07:46:08 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:46:08 user nova-compute[74080]:     </disk>
Oct 16 07:46:08 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:46:08 user nova-compute[74080]:       <mac address="fa:16:3e:39:29:3e"/>
Oct 16 07:46:08 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:46:08 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:46:08 user nova-compute[74080]:       <target dev="tapb07683df-b7"/>
Oct 16 07:46:08 user nova-compute[74080]:     </interface>
Oct 16 07:46:08 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:46:08 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/console.log" append="off"/>
Oct 16 07:46:08 user nova-compute[74080]:     </serial>
Oct 16 07:46:08 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:46:08 user nova-compute[74080]:     <video>
Oct 16 07:46:08 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:46:08 user nova-compute[74080]:     </video>
Oct 16 07:46:08 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:46:08 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:46:08 user nova-compute[74080]:     </rng>
Oct 16 07:46:08 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:46:08 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:46:08 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:46:08 user nova-compute[74080]:     </memballoon>
Oct 16 07:46:08 user nova-compute[74080]:   </devices>
Oct 16 07:46:08 user nova-compute[74080]: </domain>
Oct 16 07:46:08 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-679793859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-679793859',id=38,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWhxkfuu6xvJnghzRZZ737A58JYsbtQCHTfH+owxrpU2wVCtryw1Bksx0dTRzVL+XxNM6plAQdbhKP0b5MjEX3WcblJXq8dA9PFStrdse3MAMWNS23NlkOCJ+39ghO5UA==',key_name='tempest-keypair-305204350',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-ioghq4po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=90178686-25e3-4659-8c41-adbc6fb83d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=b07683df-b70a-4078-a943-b84cf8923016,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07683df-b7') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG os_vif [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=b07683df-b70a-4078-a943-b84cf8923016,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07683df-b7') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02899b0c-33b8-5e25-8731-08a1f3890beb', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb07683df-b7, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb07683df-b7, col_values=(('qos', UUID('e8d8cef1-4c70-405f-b239-112a7b83e9e2')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb07683df-b7, col_values=(('external_ids', {'iface-id': 'b07683df-b70a-4078-a943-b84cf8923016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:29:3e', 'vm-uuid': '90178686-25e3-4659-8c41-adbc6fb83d63'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No VIF found with MAC fa:16:3e:ad:72:b6, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: INFO os_vif [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=b07683df-b70a-4078-a943-b84cf8923016,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07683df-b7')
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] No VIF found with MAC fa:16:3e:39:29:3e, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.neutron [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Updated VIF entry in instance network info cache for port 4263b4f4-8cc3-43ff-9df6-f1af111a7e63. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.neutron [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Updating instance_info_cache with network_info: [{"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Releasing lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received event network-changed-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Refreshing instance network info cache due to event network-changed-b07683df-b70a-4078-a943-b84cf8923016. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Acquiring lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Acquired lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG nova.network.neutron [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Refreshing network info cache for port b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:09 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:09 user nova-compute[74080]: DEBUG nova.network.neutron [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updated VIF entry in instance network info cache for port b07683df-b70a-4078-a943-b84cf8923016. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:46:09 user nova-compute[74080]: DEBUG nova.network.neutron [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updating instance_info_cache with network_info: [{"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-30e4667c-7081-4fb9-9ea9-d5a524da5e35 req-91f7e330-be52-4e09-95cd-7496dd12fb76 service nova] Releasing lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] No waiting events found dispatching network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:10 user nova-compute[74080]: WARNING nova.compute.manager [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received unexpected event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb for instance with vm_state active and task_state reboot_started.
Oct 16 07:46:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] Lock "816158fd-6a77-4d53-9cdb-09707887bafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG nova.compute.manager [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] No waiting events found dispatching network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:10 user nova-compute[74080]: WARNING nova.compute.manager [req-82b9af27-ccdf-480a-bf16-467e4ff2bb8f req-01450dfe-7cb8-4f6f-9e21-9aeee757f6f3 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received unexpected event network-vif-plugged-6508e90b-0fb8-4d94-9a47-71a6217e8cfb for instance with vm_state active and task_state reboot_started.
Oct 16 07:46:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG nova.compute.manager [req-6fb5a534-06f7-4bee-83e2-2170b23122e9 req-51232e66-623a-4d1d-9e35-045204bb289a service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Received event network-vif-plugged-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6fb5a534-06f7-4bee-83e2-2170b23122e9 req-51232e66-623a-4d1d-9e35-045204bb289a service nova] Acquiring lock "7b61eeb2-de2e-498d-b307-852473aadb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6fb5a534-06f7-4bee-83e2-2170b23122e9 req-51232e66-623a-4d1d-9e35-045204bb289a service nova] Lock "7b61eeb2-de2e-498d-b307-852473aadb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-6fb5a534-06f7-4bee-83e2-2170b23122e9 req-51232e66-623a-4d1d-9e35-045204bb289a service nova] Lock "7b61eeb2-de2e-498d-b307-852473aadb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG nova.compute.manager [req-6fb5a534-06f7-4bee-83e2-2170b23122e9 req-51232e66-623a-4d1d-9e35-045204bb289a service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] No waiting events found dispatching network-vif-plugged-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:11 user nova-compute[74080]: WARNING nova.compute.manager [req-6fb5a534-06f7-4bee-83e2-2170b23122e9 req-51232e66-623a-4d1d-9e35-045204bb289a service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Received unexpected event network-vif-plugged-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 for instance with vm_state building and task_state spawning.
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Instance running successfully.
Oct 16 07:46:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Instance soft rebooted successfully.
Oct 16 07:46:12 user nova-compute[74080]: DEBUG nova.compute.manager [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:46:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-a151940a-4c00-44d3-b36a-2580335bccea tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 10.730s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Received event network-vif-plugged-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Acquiring lock "7b61eeb2-de2e-498d-b307-852473aadb01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Lock "7b61eeb2-de2e-498d-b307-852473aadb01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Lock "7b61eeb2-de2e-498d-b307-852473aadb01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] No waiting events found dispatching network-vif-plugged-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:13 user nova-compute[74080]: WARNING nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Received unexpected event network-vif-plugged-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 for instance with vm_state building and task_state spawning.
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received event network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Acquiring lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] No waiting events found dispatching network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:13 user nova-compute[74080]: WARNING nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received unexpected event network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 for instance with vm_state building and task_state spawning.
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received event network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Acquiring lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] No waiting events found dispatching network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:13 user nova-compute[74080]: WARNING nova.compute.manager [req-eae75b55-2eb2-454c-95b6-d85c630e3c68 req-f23cc59b-c2e3-4c96-8f6e-049d6d2b7193 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received unexpected event network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 for instance with vm_state building and task_state spawning.
Oct 16 07:46:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:46:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Instance spawned successfully.
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:46:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:46:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Instance spawned successfully.
Oct 16 07:46:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:46:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:46:14 user nova-compute[74080]: INFO nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Took 9.69 seconds to spawn the instance on the hypervisor.
Oct 16 07:46:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:46:14 user nova-compute[74080]: INFO nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Took 8.93 seconds to spawn the instance on the hypervisor.
Oct 16 07:46:14 user nova-compute[74080]: DEBUG nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:46:14 user nova-compute[74080]: INFO nova.compute.manager [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Took 10.75 seconds to build instance.
Oct 16 07:46:14 user nova-compute[74080]: INFO nova.compute.manager [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Took 10.64 seconds to build instance.
Oct 16 07:46:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b1288386-2ff2-4c4c-bbc8-9ca8eca9aa46 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "90178686-25e3-4659-8c41-adbc6fb83d63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.865s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-054f78df-0eab-4b74-a822-66c9e7db3c88 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.750s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:18 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:19 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Rebuilding the list of instances to heal {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lazy-loading 'info_cache' on Instance uuid dd394796-510c-4990-aaa7-7f479173c476 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updating instance_info_cache with network_info: [{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:21 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:46:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:46:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:46:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74080) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 07:46:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:46:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74080) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 07:46:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:24 user nova-compute[74080]: INFO nova.compute.manager [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Unrescuing
Oct 16 07:46:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquired lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvaLFdDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:46:25 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:46:25 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:46:25 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[91843923-f497-4ce6-a9b7-9958e9f901fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:46:25 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da8e64b-e981-44ad-9bfb-7120f5852146]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a] added
Oct 16 07:46:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a808444-b6c3-4199-8149-da54d727d10a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a677b4-325f-4215-9e0a-35b2b8145909]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvaLFdDX {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zvaLFdDX" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0899ecd7-fc0f-4774-9d0f-d773067f59d3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zvaLFdDX'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a3a01-d9e0-422b-adc3-a435346c1f72]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c8b9db-0c28-4fe0-8c38-7a1398fecc99]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e534820-8539-4a1e-aaa4-83f45a45302f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260]
Oct 16 07:46:25 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260] successful.
Oct 16 07:46:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d981794a-d2ab-4ee9-a285-e162e301e194]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b48744a-76b1-4931-a57b-403d5da30b6e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:46:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:25 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:46:25 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61377e-c0f7-4c73-ad4b-86a8af31da42]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvaLFdDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG nova.network.neutron [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Releasing lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG nova.objects.instance [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'flavor' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-e06ed445-c754-4bbb-822e-b6d917dca506 req-03e062b5-0b26-44fe-84cf-ece4d7a6c186 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e06ed445-c754-4bbb-822e-b6d917dca506 req-03e062b5-0b26-44fe-84cf-ece4d7a6c186 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e06ed445-c754-4bbb-822e-b6d917dca506 req-03e062b5-0b26-44fe-84cf-ece4d7a6c186 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e06ed445-c754-4bbb-822e-b6d917dca506 req-03e062b5-0b26-44fe-84cf-ece4d7a6c186 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG nova.compute.manager [req-e06ed445-c754-4bbb-822e-b6d917dca506 req-03e062b5-0b26-44fe-84cf-ece4d7a6c186 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:26 user nova-compute[74080]: WARNING nova.compute.manager [req-e06ed445-c754-4bbb-822e-b6d917dca506 req-03e062b5-0b26-44fe-84cf-ece4d7a6c186 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:46:26 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26536663534356235', 'path': '/dev/sde'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536663534356235', 'path': '/dev/sde'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:26 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:46:26 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:46:26 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:46:26 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:46:26 user nova-compute[74080]:   <serial>30bf0ffc-bb44-4066-8d99-6210af53c01a</serial>
Oct 16 07:46:26 user nova-compute[74080]: </disk>
Oct 16 07:46:26 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:46:27 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance destroyed successfully.
Oct 16 07:46:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No VIF found with MAC fa:16:3e:42:13:c2, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dc681edd-1333-4ee4-8b78-7c60b6cc2ee4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.647s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:27 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG nova.compute.manager [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing instance network info cache due to event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Acquiring lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Acquired lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG nova.network.neutron [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:46:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updated VIF entry in instance network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Releasing lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing instance network info cache due to event network-changed-d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Acquiring lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Acquired lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Refreshing network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updated VIF entry in instance network info cache for port d5f6c16f-cc65-486c-a75e-06889c7b1d9f. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.network.neutron [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [{"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Releasing lock "refresh_cache-b50a04d5-3359-4be0-879a-0fc018b0ed3e" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:29 user nova-compute[74080]: WARNING nova.compute.manager [req-1e20f44c-4afd-402a-b253-5115dd59a8ac req-f3be6a81-3207-469d-a8e9-b9241e8ea2bf service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:30 user nova-compute[74080]: WARNING nova.compute.manager [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:46:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG nova.compute.manager [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:46:30 user nova-compute[74080]: WARNING nova.compute.manager [req-c6eea80c-6455-4abd-aeb7-107b4bbad06b req-6d74e257-a5bc-4668-b657-55fbae22e644 service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state rescued and task_state unrescuing.
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG nova.compute.manager [None req-bee41041-4edf-4d55-8f1f-ef6c69034068 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:46:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.006s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:33 user nova-compute[74080]: INFO nova.compute.manager [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Attaching volume b8b9631d-ca79-435a-a8b0-1f8511b4d574 to /dev/vdc
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG os_brick.utils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6532e44-01e0-4dfa-b465-2407acbfd24a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba249ab6-875d-424e-a9e2-b65c38e5c712]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a3964a-6a4d-48a7-8cef-c17b42634e9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3eff6f-dcb9-4bda-a575-d08bfc88bcc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:46:33 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[757e6917-bc08-40b0-8c7a-1ddd7a942831]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG os_brick.utils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updating existing volume attachment record: 238a8e11-df35-4087-97ad-793150e10b30 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:35 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:46:35 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=6948MB free_disk=24.705368041992188GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance bc44f5cc-26d8-4ff2-a868-432143effed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 816158fd-6a77-4d53-9cdb-09707887bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 06d935f9-585b-4d7b-aa6e-8bfe7085edd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance fa351f45-3a41-4f50-b38e-62c8a5bacbdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 90178686-25e3-4659-8c41-adbc6fb83d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 7b61eeb2-de2e-498d-b307-852473aadb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:35 user nova-compute[74080]: DEBUG nova.compute.manager [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:46:36 user nova-compute[74080]: INFO nova.compute.manager [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] instance snapshotting
Oct 16 07:46:36 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Beginning live snapshot process
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json -f qcow2 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqh1uo_qe/d981d790928142279ef7b57f9f3de486.delta 1073741824 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqh1uo_qe/d981d790928142279ef7b57f9f3de486.delta 1073741824" returned: 0 in 0.058s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:36 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 07:46:37 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:46:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74080) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 07:46:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 07:46:38 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:46:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqh1uo_qe/d981d790928142279ef7b57f9f3de486.delta /opt/stack/data/nova/instances/snapshots/tmpqh1uo_qe/d981d790928142279ef7b57f9f3de486 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:38 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqh1uo_qe/d981d790928142279ef7b57f9f3de486.delta /opt/stack/data/nova/instances/snapshots/tmpqh1uo_qe/d981d790928142279ef7b57f9f3de486" returned: 0 in 0.500s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Snapshot extracted, beginning image upload
Oct 16 07:46:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Snapshot image upload complete
Oct 16 07:46:41 user nova-compute[74080]: INFO nova.compute.manager [None req-f25b8cca-04f7-4ceb-a833-1861b0948a1b tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1] Took 5.50 seconds to snapshot the instance on the hypervisor.
Oct 16 07:46:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Received event network-changed-74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Refreshing instance network info cache due to event network-changed-74baa473-bf01-4431-b89d-a2390dd766ac. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] Acquiring lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] Acquired lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Refreshing network info cache for port 74baa473-bf01-4431-b89d-a2390dd766ac {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Updated VIF entry in instance network info cache for port 74baa473-bf01-4431-b89d-a2390dd766ac. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG nova.network.neutron [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] [instance: 06d935f9-585b-4d7b-aa6e-8bfe7085edd7] Updating instance_info_cache with network_info: [{"id": "74baa473-bf01-4431-b89d-a2390dd766ac", "address": "fa:16:3e:35:7c:40", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74baa473-bf", "ovs_interfaceid": "74baa473-bf01-4431-b89d-a2390dd766ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b48d48d1-ae07-4dcb-8aeb-3b47dc2e292a req-b8f70780-7189-49a1-a11b-32c668559beb service nova] Releasing lock "refresh_cache-06d935f9-585b-4d7b-aa6e-8bfe7085edd7" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfrPixdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:46:49 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:46:49 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:46:49 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[548da725-f9d1-46a2-a420-2c02220a932b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:46:49 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee01f53-e5ae-4a97-8e36-7f5941a7b081]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574] added
Oct 16 07:46:49 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1838ad34-62f4-49bf-9fc7-2f4267ef5ca3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b42f1-aabf-43c8-8480-d50eb364f8a3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfrPixdR {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfrPixdR" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa916c45-7563-4792-9fd4-ed91e047a167]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfrPixdR'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:49 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d79abdd-49c0-4b57-ac6a-357af59a1333]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a5ffa-521d-4292-98ce-14c2168335a5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:46:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:46:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[187220aa-d21c-4146-8243-6279ab6e0131]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260]
Oct 16 07:46:50 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260] successful.
Oct 16 07:46:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb323de-8185-41c7-8c51-2c5715b8294d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9f8e12-c554-4fdc-babe-c87cda24fa15]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:46:50 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:46:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] HCTL ('38', '-', '-', 0) found on session 45 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3932c5eb-ac4b-40e5-b114-e201f898b025]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:46:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfrPixdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:46:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:46:51 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26439666139346666', 'path': '/dev/sdg'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:46:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439666139346666', 'path': '/dev/sdg'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:46:51 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:46:51 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:46:51 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:46:51 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:46:51 user nova-compute[74080]:   <target dev="vdc" bus="virtio"/>
Oct 16 07:46:51 user nova-compute[74080]:   <serial>b8b9631d-ca79-435a-a8b0-1f8511b4d574</serial>
Oct 16 07:46:51 user nova-compute[74080]: </disk>
Oct 16 07:46:51 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:46:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:46:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:46:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:46:52 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] No VIF found with MAC fa:16:3e:42:13:c2, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:46:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b767785d-bb20-4f41-bef4-41ee3db9e257 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.733s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:53 user nova-compute[74080]: INFO nova.compute.manager [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Detaching volume 30bf0ffc-bb44-4066-8d99-6210af53c01a
Oct 16 07:46:53 user nova-compute[74080]: INFO nova.virt.block_device [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Attempting to driver detach volume 30bf0ffc-bb44-4066-8d99-6210af53c01a from mountpoint /dev/vdb
Oct 16 07:46:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Attempting to detach device vdb from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:46:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:46:53 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:46:53 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:46:53 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:46:53 user nova-compute[74080]:   <serial>30bf0ffc-bb44-4066-8d99-6210af53c01a</serial>
Oct 16 07:46:53 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:46:53 user nova-compute[74080]: </disk>
Oct 16 07:46:53 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:46:53 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully detached device vdb from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the persistent domain config.
Oct 16 07:46:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:46:53 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:46:53 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:46:53 user nova-compute[74080]:   <source dev="/dev/sde"/>
Oct 16 07:46:53 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:46:53 user nova-compute[74080]:   <serial>30bf0ffc-bb44-4066-8d99-6210af53c01a</serial>
Oct 16 07:46:53 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:46:53 user nova-compute[74080]: </disk>
Oct 16 07:46:53 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:46:54 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:46:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:54 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:46:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:54 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:46:54 user nova-compute[74080]: INFO nova.compute.claims [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Claim successful on node user
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:46:55 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.policy [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c63d981ba0f4e5fa162e8f2cd6064b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee952431351406291cab2310d4a54fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:46:55 user nova-compute[74080]: INFO nova.virt.block_device [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Booting with volume 3b0d2ca9-5bfa-42ad-990a-e0da99744043 at /dev/vda
Oct 16 07:46:55 user nova-compute[74080]: DEBUG os_brick.utils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4dfb83-631b-4f90-b422-1b9f21dbbc42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0901be-075a-41cf-9dee-bfe55c7ed832]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7883f937-61b0-4ff5-99dc-e41ee8ff12ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dd6da7-8c95-4780-bc90-515df4717565]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:46:55 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:46:55 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[742abef1-913e-4304-b9ed-8115e35f586f]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG os_brick.utils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:46:55 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updating existing volume attachment record: 04dbe8eb-8f76-4a36-98cd-f8406fb2b578 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:46:56 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Successfully created port: 3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Successfully updated port: 3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received event network-changed-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.compute.manager [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Refreshing instance network info cache due to event network-changed-3b6cdf68-626e-4472-9e45-a9bbb5ec0630. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] Acquiring lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] Acquired lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Refreshing network info cache for port 3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-683020d2-f07d-4937-a7c3-fe9d54f057c1 req-147363b6-ea72-48b2-9d02-5cb26e591148 service nova] Releasing lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquired lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:46:57 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG nova.network.neutron [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updating instance_info_cache with network_info: [{"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Releasing lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Instance network_info: |[{"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:46:58 user nova-compute[74080]: INFO nova.compute.manager [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Detaching volume 960e960a-18a4-41a4-ab31-3a4927e93ff1
Oct 16 07:46:58 user nova-compute[74080]: INFO nova.virt.block_device [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Attempting to driver detach volume 960e960a-18a4-41a4-ab31-3a4927e93ff1 from mountpoint /dev/vdb
Oct 16 07:46:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Attempting to detach device vdb from instance b50a04d5-3359-4be0-879a-0fc018b0ed3e from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:46:58 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:46:58 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:46:58 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:46:58 user nova-compute[74080]:   <serial>960e960a-18a4-41a4-ab31-3a4927e93ff1</serial>
Oct 16 07:46:58 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:46:58 user nova-compute[74080]: </disk>
Oct 16 07:46:58 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:46:58 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Successfully detached device vdb from instance b50a04d5-3359-4be0-879a-0fc018b0ed3e from the persistent domain config.
Oct 16 07:46:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b50a04d5-3359-4be0-879a-0fc018b0ed3e from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:46:58 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:46:58 user nova-compute[74080]:   <source dev="/dev/sdb"/>
Oct 16 07:46:58 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:46:58 user nova-compute[74080]:   <serial>960e960a-18a4-41a4-ab31-3a4927e93ff1</serial>
Oct 16 07:46:58 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:46:58 user nova-compute[74080]: </disk>
Oct 16 07:46:58 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:46:58 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:47:01 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "dd0f5024-3a97-4828-812f-a984414b164d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "dd0f5024-3a97-4828-812f-a984414b164d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:06 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:47:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:06 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:06 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:47:06 user nova-compute[74080]: INFO nova.compute.claims [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Claim successful on node user
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.846s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:47:07 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.policy [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33b58ae309d047548ebf29684db6037e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8b70039a31c47f39f7bf1b01b4e6e79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:47:07 user nova-compute[74080]: INFO nova.virt.block_device [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Booting with volume 69230c1c-d58b-47f4-9119-a95e4789478a at /dev/vda
Oct 16 07:47:07 user nova-compute[74080]: DEBUG os_brick.utils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9629b25d-abd5-4aed-b945-793891a8b4a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa102791-48d7-41f5-8966-ea8319cb8845]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb7a1ff-227a-4a70-9623-ec9424a1c42b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f542b6-468b-4e46-bbf8-f863da0c9270]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:47:07 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:47:07 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e002e94-82da-421b-8995-e6cb102a7b8e]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG os_brick.utils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:07 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Updating existing volume attachment record: 516108c5-87e0-45ae-bbfb-fe96d9bec20f {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Successfully created port: 7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Successfully updated port: 7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "refresh_cache-dd0f5024-3a97-4828-812f-a984414b164d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquired lock "refresh_cache-dd0f5024-3a97-4828-812f-a984414b164d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Received event network-changed-7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG nova.compute.manager [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Refreshing instance network info cache due to event network-changed-7353b2e5-3514-4f44-87d1-663421762754. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] Acquiring lock "refresh_cache-dd0f5024-3a97-4828-812f-a984414b164d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:08 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG nova.network.neutron [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Updating instance_info_cache with network_info: [{"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Releasing lock "refresh_cache-dd0f5024-3a97-4828-812f-a984414b164d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Instance network_info: |[{"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] Acquired lock "refresh_cache-dd0f5024-3a97-4828-812f-a984414b164d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG nova.network.neutron [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Refreshing network info cache for port 7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG nova.network.neutron [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Updated VIF entry in instance network info cache for port 7353b2e5-3514-4f44-87d1-663421762754. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG nova.network.neutron [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Updating instance_info_cache with network_info: [{"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:09 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-38806993-61d4-4b9e-b82e-8e6447d39164 req-c635b14f-050d-4868-b9fa-9dc6130dc6f6 service nova] Releasing lock "refresh_cache-dd0f5024-3a97-4828-812f-a984414b164d" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-changed-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG nova.compute.manager [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Refreshing instance network info cache due to event network-changed-4a6b5e9d-7a95-40e7-b890-e9500d69d682. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] Acquiring lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] Acquired lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG nova.network.neutron [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Refreshing network info cache for port 4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG nova.objects.instance [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'flavor' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:13 user nova-compute[74080]: INFO nova.compute.manager [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Attaching volume 764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 to /dev/vdb
Oct 16 07:47:13 user nova-compute[74080]: DEBUG nova.network.neutron [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Updated VIF entry in instance network info cache for port 4a6b5e9d-7a95-40e7-b890-e9500d69d682. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG nova.network.neutron [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Updating instance_info_cache with network_info: [{"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-e48aa343-c9fb-4c98-b765-26abc4d5e87b req-3266e7b9-1de2-4bff-90b8-28130710e15e service nova] Releasing lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG os_brick.utils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc79006-6f5b-489e-9b52-744036891050]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a63233-b673-46fc-811f-bcf58e88bfe0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf9476-7b3e-4ebb-9cd5-6fe19df2f054]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1694db-2b92-43a4-bda8-78952bb9e4cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:47:13 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:47:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc4f90c-1c8d-4a03-9f39-b2587249a5c1]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG os_brick.utils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:13 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Updating existing volume attachment record: 5f18375a-f319-4c11-b2be-95b7025029af {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:47:14 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f is timed out.
Oct 16 07:47:14 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully detached device vdb from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the live domain config.
Oct 16 07:47:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zvaLFdDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:14 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb1725-fa5a-4095-8805-6c5355135bd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:47:14 user nova-compute[74080]: No targets found.
Oct 16 07:47:14 user nova-compute[74080]: iSNS:
Oct 16 07:47:14 user nova-compute[74080]: No targets found.
Oct 16 07:47:14 user nova-compute[74080]: STATIC:
Oct 16 07:47:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574
Oct 16 07:47:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a
Oct 16 07:47:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:47:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84
Oct 16 07:47:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33
Oct 16 07:47:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:14 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1
Oct 16 07:47:14 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:14 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:14 user nova-compute[74080]: FIRMWARE:
Oct 16 07:47:14 user nova-compute[74080]: No targets found.
Oct 16 07:47:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:47:14 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:47:14 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1a0b6-725b-4cd7-baf5-6693c83104eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c172df98-a6c0-43df-8c34-4b7b4310b0b2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a (non-flash)
Oct 16 07:47:14 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7c4250d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a'): ({'sde'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Removing single pathed devices sde {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b124ae53-7be1-4c67-a8db-a965dc43e2a7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6394c30-a636-4dbf-b960-cb12a010ac2c]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flushing IO for device /dev/sde {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d065ac4-933e-46ef-8064-edbd9274e083]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126f25b-b4ec-4a94-829e-53da325e28cc]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b05f010-1e5e-4643-9948-e0c642fcef05]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[79752b4b-f093-48dd-96e4-46efac7541e9]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260]
Oct 16 07:47:14 user nova-compute[74080]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a, portal: 172.16.0.220,3260] successful.
Oct 16 07:47:14 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30bf0ffc-bb44-4066-8d99-6210af53c01a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5536381-5b58-498f-b638-f504120c95f0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== disconnect_volume: return (338ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-bc853b40-93e9-4dde-adb0-11bb862dd615 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.353s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:47:18 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Creating image(s)
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Ensure instance console log exists: /opt/stack/data/nova/instances/88dbb56c-82a7-46ca-b8eb-808d56b624ba/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Start _get_guest_xml network_info=[{"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '04dbe8eb-8f76-4a36-98cd-f8406fb2b578', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYzcZwCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88dbb56c-82a7-46ca-b8eb-808d56b624ba', 'attached_at': '', 'detached_at': '', 'volume_id': '3b0d2ca9-5bfa-42ad-990a-e0da99744043', 'serial': '3b0d2ca9-5bfa-42ad-990a-e0da99744043'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:47:18 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:18 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYzcZwCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:18 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:18 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:18 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a636d-221b-4535-abf8-8cccf8b341c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:47:18 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ed71d8-6100-49d1-9ca9-d96354e96470]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043] added
Oct 16 07:47:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86d5fd3-f67b-4132-8094-238994615801]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c065ca-a299-4021-a41f-56106b503d22]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYzcZwCu {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYzcZwCu" returned: 0 in 0.073s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[045dd9f3-9ef7-46a9-9e8d-a39a61fd3f4d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYzcZwCu'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e26f3a-145c-4d4e-8e2a-fcfe84866cd4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5688746c-5a42-45d9-a674-454cbec6dbcf]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8c098b-50c5-4e36-9b69-855c5b7016a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260]
Oct 16 07:47:18 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260] successful.
Oct 16 07:47:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf38c81-ff32-4cc5-bdde-e8d14bacfa9b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0df20-794c-45a5-ac56-dcafd436db82]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:18 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:47:18 user nova-compute[74080]: INFO nova.compute.manager [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Detaching volume b8b9631d-ca79-435a-a8b0-1f8511b4d574
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d6a52a-a006-4d9d-9208-9595bf86fa94]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYzcZwCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:47:18 user nova-compute[74080]: INFO nova.virt.block_device [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Attempting to driver detach volume b8b9631d-ca79-435a-a8b0-1f8511b4d574 from mountpoint /dev/vdc
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Attempting to detach device vdc from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:47:18 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:47:18 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:47:18 user nova-compute[74080]:   <target dev="vdc" bus="virtio"/>
Oct 16 07:47:18 user nova-compute[74080]:   <serial>b8b9631d-ca79-435a-a8b0-1f8511b4d574</serial>
Oct 16 07:47:18 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 07:47:18 user nova-compute[74080]: </disk>
Oct 16 07:47:18 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:47:18 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully detached device vdc from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the persistent domain config.
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:47:18 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:47:18 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:47:18 user nova-compute[74080]:   <target dev="vdc" bus="virtio"/>
Oct 16 07:47:18 user nova-compute[74080]:   <serial>b8b9631d-ca79-435a-a8b0-1f8511b4d574</serial>
Oct 16 07:47:18 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 07:47:18 user nova-compute[74080]: </disk>
Oct 16 07:47:18 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:47:18 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b50a04d5-3359-4be0-879a-0fc018b0ed3e is timed out.
Oct 16 07:47:18 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Successfully detached device vdb from instance b50a04d5-3359-4be0-879a-0fc018b0ed3e from the live domain config.
Oct 16 07:47:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcuwjUkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:18 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:18 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23137636162303837', 'path': '/dev/sde'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137636162303837', 'path': '/dev/sde'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.716s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-735357343',display_name='tempest-ServerActionsTestOtherA-server-735357343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-735357343',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZLgcCjtOjRhtVEk66lTNvJCeVtg0/HRqeB+2N63b7XuoepjdGinmp3abF9v/R3VFjwY/zIQcPIO8tqTm4LN5wPV1fx01ZgUseGdlfitkfPwyEsROdJBfZEWEz0lOUgsQ==',key_name='tempest-keypair-108407981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-ebk5czgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=88dbb56c-82a7-46ca-b8eb-808d56b624ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7c:a2,bridge_name='br-int',has_traffic_filtering=True,id=3b6cdf68-626e-4472-9e45-a9bbb5ec0630,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b6cdf68-62') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.objects.instance [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lazy-loading 'pci_devices' on Instance uuid 88dbb56c-82a7-46ca-b8eb-808d56b624ba {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6233591-3c88-431e-8704-09e7c6c33247]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:47:19 user nova-compute[74080]: No targets found.
Oct 16 07:47:19 user nova-compute[74080]: iSNS:
Oct 16 07:47:19 user nova-compute[74080]: No targets found.
Oct 16 07:47:19 user nova-compute[74080]: STATIC:
Oct 16 07:47:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574
Oct 16 07:47:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:47:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84
Oct 16 07:47:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33
Oct 16 07:47:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1
Oct 16 07:47:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:19 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043
Oct 16 07:47:19 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:19 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:19 user nova-compute[74080]: FIRMWARE:
Oct 16 07:47:19 user nova-compute[74080]: No targets found.
Oct 16 07:47:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:47:19 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:47:19 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:47:19 user nova-compute[74080]:   <uuid>88dbb56c-82a7-46ca-b8eb-808d56b624ba</uuid>
Oct 16 07:47:19 user nova-compute[74080]:   <name>instance-00000028</name>
Oct 16 07:47:19 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:47:19 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:47:19 user nova-compute[74080]:   <metadata>
Oct 16 07:47:19 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:47:19 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:47:19 user nova-compute[74080]:       <nova:name>tempest-ServerActionsTestOtherA-server-735357343</nova:name>
Oct 16 07:47:19 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:47:18</nova:creationTime>
Oct 16 07:47:19 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:47:19 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:47:19 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:47:19 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:47:19 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:47:19 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:47:19 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:47:19 user nova-compute[74080]:       <nova:owner>
Oct 16 07:47:19 user nova-compute[74080]:         <nova:user uuid="0c63d981ba0f4e5fa162e8f2cd6064b9">tempest-ServerActionsTestOtherA-481627845-project-member</nova:user>
Oct 16 07:47:19 user nova-compute[74080]:         <nova:project uuid="0ee952431351406291cab2310d4a54fd">tempest-ServerActionsTestOtherA-481627845</nova:project>
Oct 16 07:47:19 user nova-compute[74080]:       </nova:owner>
Oct 16 07:47:19 user nova-compute[74080]:       <nova:ports>
Oct 16 07:47:19 user nova-compute[74080]:         <nova:port uuid="3b6cdf68-626e-4472-9e45-a9bbb5ec0630">
Oct 16 07:47:19 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 07:47:19 user nova-compute[74080]:         </nova:port>
Oct 16 07:47:19 user nova-compute[74080]:       </nova:ports>
Oct 16 07:47:19 user nova-compute[74080]:     </nova:instance>
Oct 16 07:47:19 user nova-compute[74080]:   </metadata>
Oct 16 07:47:19 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:47:19 user nova-compute[74080]:     <system>
Oct 16 07:47:19 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:47:19 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:47:19 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:47:19 user nova-compute[74080]:       <entry name="serial">88dbb56c-82a7-46ca-b8eb-808d56b624ba</entry>
Oct 16 07:47:19 user nova-compute[74080]:       <entry name="uuid">88dbb56c-82a7-46ca-b8eb-808d56b624ba</entry>
Oct 16 07:47:19 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:47:19 user nova-compute[74080]:     </system>
Oct 16 07:47:19 user nova-compute[74080]:   </sysinfo>
Oct 16 07:47:19 user nova-compute[74080]:   <os>
Oct 16 07:47:19 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:47:19 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:47:19 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:47:19 user nova-compute[74080]:   </os>
Oct 16 07:47:19 user nova-compute[74080]:   <features>
Oct 16 07:47:19 user nova-compute[74080]:     <acpi/>
Oct 16 07:47:19 user nova-compute[74080]:     <apic/>
Oct 16 07:47:19 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:47:19 user nova-compute[74080]:   </features>
Oct 16 07:47:19 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:47:19 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:47:19 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:47:19 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:47:19 user nova-compute[74080]:   </clock>
Oct 16 07:47:19 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:47:19 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:47:19 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:47:19 user nova-compute[74080]:   </cpu>
Oct 16 07:47:19 user nova-compute[74080]:   <devices>
Oct 16 07:47:19 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:47:19 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:47:19 user nova-compute[74080]:       <source dev="/dev/sde"/>
Oct 16 07:47:19 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:47:19 user nova-compute[74080]:       <serial>3b0d2ca9-5bfa-42ad-990a-e0da99744043</serial>
Oct 16 07:47:19 user nova-compute[74080]:     </disk>
Oct 16 07:47:19 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:47:19 user nova-compute[74080]:       <mac address="fa:16:3e:7f:7c:a2"/>
Oct 16 07:47:19 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:47:19 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:47:19 user nova-compute[74080]:       <target dev="tap3b6cdf68-62"/>
Oct 16 07:47:19 user nova-compute[74080]:     </interface>
Oct 16 07:47:19 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:47:19 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/88dbb56c-82a7-46ca-b8eb-808d56b624ba/console.log" append="off"/>
Oct 16 07:47:19 user nova-compute[74080]:     </serial>
Oct 16 07:47:19 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:47:19 user nova-compute[74080]:     <video>
Oct 16 07:47:19 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:47:19 user nova-compute[74080]:     </video>
Oct 16 07:47:19 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:47:19 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:47:19 user nova-compute[74080]:     </rng>
Oct 16 07:47:19 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:47:19 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:47:19 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:47:19 user nova-compute[74080]:     </memballoon>
Oct 16 07:47:19 user nova-compute[74080]:   </devices>
Oct 16 07:47:19 user nova-compute[74080]: </domain>
Oct 16 07:47:19 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-735357343',display_name='tempest-ServerActionsTestOtherA-server-735357343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-735357343',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZLgcCjtOjRhtVEk66lTNvJCeVtg0/HRqeB+2N63b7XuoepjdGinmp3abF9v/R3VFjwY/zIQcPIO8tqTm4LN5wPV1fx01ZgUseGdlfitkfPwyEsROdJBfZEWEz0lOUgsQ==',key_name='tempest-keypair-108407981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-ebk5czgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:46:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=88dbb56c-82a7-46ca-b8eb-808d56b624ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7c:a2,bridge_name='br-int',has_traffic_filtering=True,id=3b6cdf68-626e-4472-9e45-a9bbb5ec0630,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b6cdf68-62') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_vif [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7c:a2,bridge_name='br-int',has_traffic_filtering=True,id=3b6cdf68-626e-4472-9e45-a9bbb5ec0630,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b6cdf68-62') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ed6ddb8-5d60-5dc6-9c63-f93d4cd1f3ef', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d813a16-6922-422a-8126-a0630d31994d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b6cdf68-62, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b6cdf68-62, col_values=(('qos', UUID('005e139a-6933-4bca-a747-b34f0e7fd2e5')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b6cdf68-62, col_values=(('external_ids', {'iface-id': '3b6cdf68-626e-4472-9e45-a9bbb5ec0630', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:7c:a2', 'vm-uuid': '88dbb56c-82a7-46ca-b8eb-808d56b624ba'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:19 user nova-compute[74080]: INFO os_vif [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:7c:a2,bridge_name='br-int',has_traffic_filtering=True,id=3b6cdf68-626e-4472-9e45-a9bbb5ec0630,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b6cdf68-62')
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7783322c-aedf-4234-a0e2-2d57670018c6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7cff82290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1'): ({'sdb'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Removing single pathed devices sdb {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7459e2b3-9e0b-48e7-9c4a-efb26184401d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] No VIF found with MAC fa:16:3e:7f:7c:a2, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c21d0-02b6-49b3-a721-e9bea7d0b83a]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Flushing IO for device /dev/sdb {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[65adc89a-e99e-4b14-9f5d-960a9648980c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7ed0bb-1b5c-4cef-876e-c21d4b8bb614]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] SCSI volumes sdb have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a3d3b9-67cb-42b9-bc89-064bc2f0ef2b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf7ad59-a19c-4229-b633-cec8b3d7fe78]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260]
Oct 16 07:47:19 user nova-compute[74080]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1, portal: 172.16.0.220,3260] successful.
Oct 16 07:47:19 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:19 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960e960a-18a4-41a4-ab31-3a4927e93ff1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[58885bb8-8130-4a05-aa22-5edb0c1a8dcd]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] <== disconnect_volume: return (1053ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG nova.objects.instance [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'flavor' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:20 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5916e425-337d-456b-91a9-23afee3a0300 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.461s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-389bcc4f-e983-401b-91f5-0c8305d43a1d req-d68e1ffa-5a64-4c28-bfd1-edc85096afbc service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received event network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-389bcc4f-e983-401b-91f5-0c8305d43a1d req-d68e1ffa-5a64-4c28-bfd1-edc85096afbc service nova] Acquiring lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-389bcc4f-e983-401b-91f5-0c8305d43a1d req-d68e1ffa-5a64-4c28-bfd1-edc85096afbc service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-389bcc4f-e983-401b-91f5-0c8305d43a1d req-d68e1ffa-5a64-4c28-bfd1-edc85096afbc service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG nova.compute.manager [req-389bcc4f-e983-401b-91f5-0c8305d43a1d req-d68e1ffa-5a64-4c28-bfd1-edc85096afbc service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] No waiting events found dispatching network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:21 user nova-compute[74080]: WARNING nova.compute.manager [req-389bcc4f-e983-401b-91f5-0c8305d43a1d req-d68e1ffa-5a64-4c28-bfd1-edc85096afbc service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received unexpected event network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 for instance with vm_state building and task_state spawning.
Oct 16 07:47:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:21 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:47:23 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Instance spawned successfully.
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:23 user nova-compute[74080]: INFO nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Took 5.19 seconds to spawn the instance on the hypervisor.
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-9ae45c96-a62b-4c28-bb8d-09be0a2473e8 req-dedcfd31-123d-43d2-8afe-80717385d66d service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received event network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9ae45c96-a62b-4c28-bb8d-09be0a2473e8 req-dedcfd31-123d-43d2-8afe-80717385d66d service nova] Acquiring lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9ae45c96-a62b-4c28-bb8d-09be0a2473e8 req-dedcfd31-123d-43d2-8afe-80717385d66d service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9ae45c96-a62b-4c28-bb8d-09be0a2473e8 req-dedcfd31-123d-43d2-8afe-80717385d66d service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.compute.manager [req-9ae45c96-a62b-4c28-bb8d-09be0a2473e8 req-dedcfd31-123d-43d2-8afe-80717385d66d service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] No waiting events found dispatching network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:23 user nova-compute[74080]: WARNING nova.compute.manager [req-9ae45c96-a62b-4c28-bb8d-09be0a2473e8 req-dedcfd31-123d-43d2-8afe-80717385d66d service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received unexpected event network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 for instance with vm_state building and task_state spawning.
Oct 16 07:47:23 user nova-compute[74080]: INFO nova.compute.manager [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Took 28.75 seconds to build instance.
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-b9187bd3-fa0a-4cee-82ae-7213412b04f6 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.902s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:47:23 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Creating image(s)
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Ensure instance console log exists: /opt/stack/data/nova/instances/dd0f5024-3a97-4828-812f-a984414b164d/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Start _get_guest_xml network_info=[{"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '516108c5-87e0-45ae-bbfb-fe96d9bec20f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgWlyFTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd0f5024-3a97-4828-812f-a984414b164d', 'attached_at': '', 'detached_at': '', 'volume_id': '69230c1c-d58b-47f4-9119-a95e4789478a', 'serial': '69230c1c-d58b-47f4-9119-a95e4789478a'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:47:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:23 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:47:23 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgWlyFTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:24 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:24 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:24 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b738e4-4c7b-4068-b43b-f4a9a512580c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:47:24 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac2da19-2333-4e72-9353-7a66ac26aeae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a] added
Oct 16 07:47:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ab14a2-162c-4aac-ab9f-99ca934b7c88]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Updating instance_info_cache with network_info: [{"id": "5391b3b8-77e6-4f76-aa53-108a47512757", "address": "fa:16:3e:1c:5c:b3", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5391b3b8-77", "ovs_interfaceid": "5391b3b8-77e6-4f76-aa53-108a47512757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a575b4-f36f-4774-85ad-96943dabe666]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgWlyFTs {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-4d6118bf-0075-4d1c-ad47-c151722a4ad0" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: 4d6118bf-0075-4d1c-ad47-c151722a4ad0] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NgWlyFTs" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5da6a-c55f-44a8-a9f9-ac6039b8f54c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NgWlyFTs'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c5827d-44f8-40e8-adc0-d6b000ae1b08]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[502d8880-9f2e-4095-878c-f012f76b9d33]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[112285b1-871e-4faa-8d1c-492d521c6c25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a, portal: 172.16.0.220,3260]
Oct 16 07:47:24 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a, portal: 172.16.0.220,3260] successful.
Oct 16 07:47:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ce5eb6-974f-4d0d-8be2-22984eee4c5f]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00addc3-ed77-489b-a34c-99aadfc48ea5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:24 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:24 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f29a765-15dc-429c-b0f5-0d8244e847c3]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:47:24 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NgWlyFTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23836363936613435', 'path': '/dev/sdb'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836363936613435', 'path': '/dev/sdb'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135267697',display_name='tempest-TestVolumeBootPattern-server-135267697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135267697',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUB4evsnJY2sT1HccGkPebZAqVN/dVr0njmKk6++1K+M1J0EeXtYJ/VhykTTCYV6t+en05gMrUhPTd7ZZ42WU1pr/6VunsCqdc5GhfD3N/4gmeez4gK3GWGniO7CnDJQ==',key_name='tempest-TestVolumeBootPattern-975136939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-nupzzft2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:47:07Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=dd0f5024-3a97-4828-812f-a984414b164d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=7353b2e5-3514-4f44-87d1-663421762754,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7353b2e5-35') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.objects.instance [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lazy-loading 'pci_devices' on Instance uuid dd0f5024-3a97-4828-812f-a984414b164d {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:47:25 user nova-compute[74080]:   <uuid>dd0f5024-3a97-4828-812f-a984414b164d</uuid>
Oct 16 07:47:25 user nova-compute[74080]:   <name>instance-00000029</name>
Oct 16 07:47:25 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:47:25 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:47:25 user nova-compute[74080]:   <metadata>
Oct 16 07:47:25 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:47:25 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:47:25 user nova-compute[74080]:       <nova:name>tempest-TestVolumeBootPattern-server-135267697</nova:name>
Oct 16 07:47:25 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:47:23</nova:creationTime>
Oct 16 07:47:25 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:47:25 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:47:25 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:47:25 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:47:25 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:47:25 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:47:25 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:47:25 user nova-compute[74080]:       <nova:owner>
Oct 16 07:47:25 user nova-compute[74080]:         <nova:user uuid="33b58ae309d047548ebf29684db6037e">tempest-TestVolumeBootPattern-959199453-project-member</nova:user>
Oct 16 07:47:25 user nova-compute[74080]:         <nova:project uuid="c8b70039a31c47f39f7bf1b01b4e6e79">tempest-TestVolumeBootPattern-959199453</nova:project>
Oct 16 07:47:25 user nova-compute[74080]:       </nova:owner>
Oct 16 07:47:25 user nova-compute[74080]:       <nova:ports>
Oct 16 07:47:25 user nova-compute[74080]:         <nova:port uuid="7353b2e5-3514-4f44-87d1-663421762754">
Oct 16 07:47:25 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 07:47:25 user nova-compute[74080]:         </nova:port>
Oct 16 07:47:25 user nova-compute[74080]:       </nova:ports>
Oct 16 07:47:25 user nova-compute[74080]:     </nova:instance>
Oct 16 07:47:25 user nova-compute[74080]:   </metadata>
Oct 16 07:47:25 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:47:25 user nova-compute[74080]:     <system>
Oct 16 07:47:25 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:47:25 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:47:25 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:47:25 user nova-compute[74080]:       <entry name="serial">dd0f5024-3a97-4828-812f-a984414b164d</entry>
Oct 16 07:47:25 user nova-compute[74080]:       <entry name="uuid">dd0f5024-3a97-4828-812f-a984414b164d</entry>
Oct 16 07:47:25 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:47:25 user nova-compute[74080]:     </system>
Oct 16 07:47:25 user nova-compute[74080]:   </sysinfo>
Oct 16 07:47:25 user nova-compute[74080]:   <os>
Oct 16 07:47:25 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:47:25 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:47:25 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:47:25 user nova-compute[74080]:   </os>
Oct 16 07:47:25 user nova-compute[74080]:   <features>
Oct 16 07:47:25 user nova-compute[74080]:     <acpi/>
Oct 16 07:47:25 user nova-compute[74080]:     <apic/>
Oct 16 07:47:25 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:47:25 user nova-compute[74080]:   </features>
Oct 16 07:47:25 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:47:25 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:47:25 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:47:25 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:47:25 user nova-compute[74080]:   </clock>
Oct 16 07:47:25 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:47:25 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:47:25 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:47:25 user nova-compute[74080]:   </cpu>
Oct 16 07:47:25 user nova-compute[74080]:   <devices>
Oct 16 07:47:25 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:47:25 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:47:25 user nova-compute[74080]:       <source dev="/dev/sdb"/>
Oct 16 07:47:25 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:47:25 user nova-compute[74080]:       <serial>69230c1c-d58b-47f4-9119-a95e4789478a</serial>
Oct 16 07:47:25 user nova-compute[74080]:     </disk>
Oct 16 07:47:25 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:47:25 user nova-compute[74080]:       <mac address="fa:16:3e:4a:75:8b"/>
Oct 16 07:47:25 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:47:25 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:47:25 user nova-compute[74080]:       <target dev="tap7353b2e5-35"/>
Oct 16 07:47:25 user nova-compute[74080]:     </interface>
Oct 16 07:47:25 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:47:25 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/dd0f5024-3a97-4828-812f-a984414b164d/console.log" append="off"/>
Oct 16 07:47:25 user nova-compute[74080]:     </serial>
Oct 16 07:47:25 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:47:25 user nova-compute[74080]:     <video>
Oct 16 07:47:25 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:47:25 user nova-compute[74080]:     </video>
Oct 16 07:47:25 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:47:25 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:47:25 user nova-compute[74080]:     </rng>
Oct 16 07:47:25 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:47:25 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:47:25 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:47:25 user nova-compute[74080]:     </memballoon>
Oct 16 07:47:25 user nova-compute[74080]:   </devices>
Oct 16 07:47:25 user nova-compute[74080]: </domain>
Oct 16 07:47:25 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:47:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-135267697',display_name='tempest-TestVolumeBootPattern-server-135267697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-135267697',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILUB4evsnJY2sT1HccGkPebZAqVN/dVr0njmKk6++1K+M1J0EeXtYJ/VhykTTCYV6t+en05gMrUhPTd7ZZ42WU1pr/6VunsCqdc5GhfD3N/4gmeez4gK3GWGniO7CnDJQ==',key_name='tempest-TestVolumeBootPattern-975136939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8b70039a31c47f39f7bf1b01b4e6e79',ramdisk_id='',reservation_id='r-nupzzft2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-959199453',owner_user_name='tempest-TestVolumeBootPattern-959199453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:47:07Z,user_data=None,user_id='33b58ae309d047548ebf29684db6037e',uuid=dd0f5024-3a97-4828-812f-a984414b164d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converting VIF {"id": "7353b2e5-3514-4f44-87d1-663421762754", "address": "fa:16:3e:4a:75:8b", "network": {"id": "3854b7e8-cc69-4e98-bb89-53d118335be1", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1137526437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8b70039a31c47f39f7bf1b01b4e6e79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7353b2e5-35", "ovs_interfaceid": "7353b2e5-3514-4f44-87d1-663421762754", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=7353b2e5-3514-4f44-87d1-663421762754,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7353b2e5-35') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG os_vif [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=7353b2e5-3514-4f44-87d1-663421762754,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7353b2e5-35') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8f13670-3a01-5616-af00-c8e29c91abc7', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7353b2e5-35, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7353b2e5-35, col_values=(('qos', UUID('dcdb8508-7146-457b-935a-34fb9f9a10c5')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7353b2e5-35, col_values=(('external_ids', {'iface-id': '7353b2e5-3514-4f44-87d1-663421762754', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:75:8b', 'vm-uuid': 'dd0f5024-3a97-4828-812f-a984414b164d'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:25 user nova-compute[74080]: INFO os_vif [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:75:8b,bridge_name='br-int',has_traffic_filtering=True,id=7353b2e5-3514-4f44-87d1-663421762754,network=Network(3854b7e8-cc69-4e98-bb89-53d118335be1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7353b2e5-35')
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:47:25 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] No VIF found with MAC fa:16:3e:4a:75:8b, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:47:26 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:26 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:26 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:47:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:26 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-a2500153-8ac3-4c42-a416-76aa83438f39 req-db001b4d-d92f-4e3c-bde4-ce492bf9d812 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Received event network-vif-plugged-7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a2500153-8ac3-4c42-a416-76aa83438f39 req-db001b4d-d92f-4e3c-bde4-ce492bf9d812 service nova] Acquiring lock "dd0f5024-3a97-4828-812f-a984414b164d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a2500153-8ac3-4c42-a416-76aa83438f39 req-db001b4d-d92f-4e3c-bde4-ce492bf9d812 service nova] Lock "dd0f5024-3a97-4828-812f-a984414b164d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:27 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-a2500153-8ac3-4c42-a416-76aa83438f39 req-db001b4d-d92f-4e3c-bde4-ce492bf9d812 service nova] Lock "dd0f5024-3a97-4828-812f-a984414b164d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:27 user nova-compute[74080]: DEBUG nova.compute.manager [req-a2500153-8ac3-4c42-a416-76aa83438f39 req-db001b4d-d92f-4e3c-bde4-ce492bf9d812 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] No waiting events found dispatching network-vif-plugged-7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:27 user nova-compute[74080]: WARNING nova.compute.manager [req-a2500153-8ac3-4c42-a416-76aa83438f39 req-db001b4d-d92f-4e3c-bde4-ce492bf9d812 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Received unexpected event network-vif-plugged-7353b2e5-3514-4f44-87d1-663421762754 for instance with vm_state building and task_state spawning.
Oct 16 07:47:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:47:29 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Instance spawned successfully.
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-2f296362-d1d2-4c60-b469-fee51a03ff46 req-30b178ae-92f7-4548-bd3e-b9857052d556 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Received event network-vif-plugged-7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2f296362-d1d2-4c60-b469-fee51a03ff46 req-30b178ae-92f7-4548-bd3e-b9857052d556 service nova] Acquiring lock "dd0f5024-3a97-4828-812f-a984414b164d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2f296362-d1d2-4c60-b469-fee51a03ff46 req-30b178ae-92f7-4548-bd3e-b9857052d556 service nova] Lock "dd0f5024-3a97-4828-812f-a984414b164d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2f296362-d1d2-4c60-b469-fee51a03ff46 req-30b178ae-92f7-4548-bd3e-b9857052d556 service nova] Lock "dd0f5024-3a97-4828-812f-a984414b164d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.compute.manager [req-2f296362-d1d2-4c60-b469-fee51a03ff46 req-30b178ae-92f7-4548-bd3e-b9857052d556 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] No waiting events found dispatching network-vif-plugged-7353b2e5-3514-4f44-87d1-663421762754 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:29 user nova-compute[74080]: WARNING nova.compute.manager [req-2f296362-d1d2-4c60-b469-fee51a03ff46 req-30b178ae-92f7-4548-bd3e-b9857052d556 service nova] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Received unexpected event network-vif-plugged-7353b2e5-3514-4f44-87d1-663421762754 for instance with vm_state building and task_state spawning.
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:29 user nova-compute[74080]: INFO nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Took 5.46 seconds to spawn the instance on the hypervisor.
Oct 16 07:47:29 user nova-compute[74080]: DEBUG nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:47:29 user nova-compute[74080]: INFO nova.compute.manager [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] [instance: dd0f5024-3a97-4828-812f-a984414b164d] Took 23.22 seconds to build instance.
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-5ec0c86c-81e4-4874-bde8-bd72e0f7434c tempest-TestVolumeBootPattern-959199453 tempest-TestVolumeBootPattern-959199453-project-member] Lock "dd0f5024-3a97-4828-812f-a984414b164d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.332s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:47:33 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:34 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:34 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=6863MB free_disk=24.614856719970703GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance b50a04d5-3359-4be0-879a-0fc018b0ed3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance bc44f5cc-26d8-4ff2-a868-432143effed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 816158fd-6a77-4d53-9cdb-09707887bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 06d935f9-585b-4d7b-aa6e-8bfe7085edd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance fa351f45-3a41-4f50-b38e-62c8a5bacbdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 90178686-25e3-4659-8c41-adbc6fb83d63 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 7b61eeb2-de2e-498d-b307-852473aadb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 88dbb56c-82a7-46ca-b8eb-808d56b624ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd0f5024-3a97-4828-812f-a984414b164d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:47:34 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:47:35 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:47:35 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:47:35 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:47:35 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:47:35 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.805s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVIbnXia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:36 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:36 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:36 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a563a7-c336-4883-8cb8-4e77b4a02fad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:47:36 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c17bc38-3281-450f-92c8-ee8c820b6934]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1] added
Oct 16 07:47:36 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d8e07-81aa-426c-9ac7-cee6ab97a5b0]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[db960e1d-2e07-422b-96d6-a96256e1f6c1]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:36 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVIbnXia {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVIbnXia" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a24af-a373-4dc7-985b-1b1956093848]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVIbnXia'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[525dcfe9-db9f-44f9-ab21-09e7e5820fbb]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3541b6ef-755b-4c9e-8093-baafb64c0b96]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.220s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e2f3a4-4d24-4bd5-ac88-84659e75c273]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1, portal: 172.16.0.220,3260]
Oct 16 07:47:37 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1, portal: 172.16.0.220,3260] successful.
Oct 16 07:47:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2898f87e-fe39-472d-ba42-ea1527b1685b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11ac0b1-9b4c-4160-b791-5faec48d6c17]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:37 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:47:37 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.502s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] HCTL ('39', '-', '-', 0) found on session 48 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[260bfe84-f259-4cfa-9a6e-ed1a7ade6af0]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching for a device in session 48 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:47:37 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVIbnXia', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:47:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] <== connect_volume: return (1567ms) {'type': 'block', 'scsi_wwn': '23661613364373431', 'path': '/dev/sdh'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661613364373431', 'path': '/dev/sdh'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:47:38 user nova-compute[74080]: DEBUG nova.objects.instance [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'flavor' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:47:38 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:47:38 user nova-compute[74080]:   <source dev="/dev/sdh"/>
Oct 16 07:47:38 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:47:38 user nova-compute[74080]:   <serial>764a5f7a-ff0e-4fce-bc56-1b3d6db354d1</serial>
Oct 16 07:47:38 user nova-compute[74080]: </disk>
Oct 16 07:47:38 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No VIF found with MAC fa:16:3e:b6:ce:e4, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:47:39 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f is timed out.
Oct 16 07:47:39 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully detached device vdc from instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f from the live domain config.
Oct 16 07:47:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfrPixdR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:39 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0739a1b3-35bd-42c5-bbaf-9389f238737a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:47:39 user nova-compute[74080]: No targets found.
Oct 16 07:47:39 user nova-compute[74080]: iSNS:
Oct 16 07:47:39 user nova-compute[74080]: No targets found.
Oct 16 07:47:39 user nova-compute[74080]: STATIC:
Oct 16 07:47:39 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574
Oct 16 07:47:39 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:39 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:39 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:47:39 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:39 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:39 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84
Oct 16 07:47:39 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:39 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:39 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33
Oct 16 07:47:39 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:39 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:39 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1
Oct 16 07:47:39 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:39 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:39 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a
Oct 16 07:47:39 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:39 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:39 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043
Oct 16 07:47:39 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:47:39 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:47:39 user nova-compute[74080]: FIRMWARE:
Oct 16 07:47:39 user nova-compute[74080]: No targets found.
Oct 16 07:47:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:47:39 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:47:39 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41b2b79-850f-4a27-bba2-93c4331dfef9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-3cbfca3e-d399-4462-bcff-1b3086a3610c tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.690s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[32326212-c067-461d-9fd4-30a598c17770]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:47:39 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:47:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac3b85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574'): ({'sdg'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Removing single pathed devices sdg {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[570f0561-49a7-499f-bdb0-173db8000c44]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd047b-9906-46a3-b87f-80bb6d7261ad]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Flushing IO for device /dev/sdg {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b06c5-1c40-4868-b904-2e1a51049b9a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c4b6b-b2f7-4480-a1cc-188793df3f51]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec417b1-4bd8-4781-8403-6be2139a551e]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[124034c9-a234-4cd4-9943-af4f6273a325]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260]
Oct 16 07:47:39 user nova-compute[74080]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574, portal: 172.16.0.220,3260] successful.
Oct 16 07:47:39 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b9631d-ca79-435a-a8b0-1f8511b4d574 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6a688-d6d7-48d5-b82c-a9f471ef09c4]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] <== disconnect_volume: return (387ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:47:39 user nova-compute[74080]: INFO nova.compute.manager [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Rescuing
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquired lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:39 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG nova.network.neutron [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Updating instance_info_cache with network_info: [{"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Releasing lock "refresh_cache-fa351f45-3a41-4f50-b38e-62c8a5bacbdd" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG nova.objects.instance [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'flavor' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-8a159026-a8e8-4806-aebf-ed1b1feeb5f4 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.941s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-4a9e90e8-b110-4d70-8a37-978c7cfc1926 req-115c1bdc-02b1-4b20-acda-b51e762b4c25 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-vif-unplugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4a9e90e8-b110-4d70-8a37-978c7cfc1926 req-115c1bdc-02b1-4b20-acda-b51e762b4c25 service nova] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4a9e90e8-b110-4d70-8a37-978c7cfc1926 req-115c1bdc-02b1-4b20-acda-b51e762b4c25 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-4a9e90e8-b110-4d70-8a37-978c7cfc1926 req-115c1bdc-02b1-4b20-acda-b51e762b4c25 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG nova.compute.manager [req-4a9e90e8-b110-4d70-8a37-978c7cfc1926 req-115c1bdc-02b1-4b20-acda-b51e762b4c25 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] No waiting events found dispatching network-vif-unplugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:40 user nova-compute[74080]: WARNING nova.compute.manager [req-4a9e90e8-b110-4d70-8a37-978c7cfc1926 req-115c1bdc-02b1-4b20-acda-b51e762b4c25 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received unexpected event network-vif-unplugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 for instance with vm_state active and task_state rescuing.
Oct 16 07:47:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:40 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Instance destroyed successfully.
Oct 16 07:47:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Attempting rescue
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74080) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Instance directory exists: not creating {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 07:47:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Creating image(s)
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Acquiring lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca --force-share --output=json" returned: 0 in 0.177s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.rescue {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ded08f10ee863e0322c1982562db0bcea9ec42ca,backing_fmt=raw /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.rescue" returned: 0 in 0.055s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lock "ded08f10ee863e0322c1982562db0bcea9ec42ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'migration_context' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.base [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<fa351f45-3a41-4f50-b38e-62c8a5bacbdd> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Created local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Start _get_guest_xml network_info=[{"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:b6:ce:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f8d6ec0a-e025-4b3f-8896-9e692aff07e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'resources' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.base [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<fa351f45-3a41-4f50-b38e-62c8a5bacbdd> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'numa_topology' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.base [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<fa351f45-3a41-4f50-b38e-62c8a5bacbdd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:47:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.base [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<fa351f45-3a41-4f50-b38e-62c8a5bacbdd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:45:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-966016608',display_name='tempest-ServerRescueNegativeTestJSON-server-966016608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-966016608',id=37,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdWYdtzD+DEQgPRArLmWf9SI9GZKa/RcWI7z9dbPjSF2CXDaxlHR2Qii5q/e4gcUzCI2drUtCgzUJz4iwfojYeH0rUx6NHJcnyL9RnwtyfDhCxzW9EAkOcbSMK27S25yA==',key_name='tempest-keypair-411109809',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:45:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='479d15d0c8ae430096c24dd442ce1e78',ramdisk_id='',reservation_id='r-nwqii3xb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2029305131',owner_user_name='tempest-ServerRescueNegativeTestJSON-2029305131-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:45:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8537fd36ebd340b09c830ab09cd16d0b',uuid=fa351f45-3a41-4f50-b38e-62c8a5bacbdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:b6:ce:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converting VIF {"id": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "address": "fa:16:3e:b6:ce:e4", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "vif_mac": "fa:16:3e:b6:ce:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a6b5e9d-7a", "ovs_interfaceid": "4a6b5e9d-7a95-40e7-b890-e9500d69d682", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ce:e4,bridge_name='br-int',has_traffic_filtering=True,id=4a6b5e9d-7a95-40e7-b890-e9500d69d682,network=Network(d9cb8ed3-9d63-4f46-bcb6-be660da32755),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a6b5e9d-7a') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.instance [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Lazy-loading 'pci_devices' on Instance uuid fa351f45-3a41-4f50-b38e-62c8a5bacbdd {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.objects.base [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] Object Instance<fa351f45-3a41-4f50-b38e-62c8a5bacbdd> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:47:41 user nova-compute[74080]:   <uuid>fa351f45-3a41-4f50-b38e-62c8a5bacbdd</uuid>
Oct 16 07:47:41 user nova-compute[74080]:   <name>instance-00000025</name>
Oct 16 07:47:41 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:47:41 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:47:41 user nova-compute[74080]:   <metadata>
Oct 16 07:47:41 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:47:41 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:47:41 user nova-compute[74080]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-966016608</nova:name>
Oct 16 07:47:41 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:47:41</nova:creationTime>
Oct 16 07:47:41 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:47:41 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:47:41 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:47:41 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:47:41 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:47:41 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:47:41 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:47:41 user nova-compute[74080]:       <nova:owner>
Oct 16 07:47:41 user nova-compute[74080]:         <nova:user uuid="8537fd36ebd340b09c830ab09cd16d0b">tempest-ServerRescueNegativeTestJSON-2029305131-project-member</nova:user>
Oct 16 07:47:41 user nova-compute[74080]:         <nova:project uuid="479d15d0c8ae430096c24dd442ce1e78">tempest-ServerRescueNegativeTestJSON-2029305131</nova:project>
Oct 16 07:47:41 user nova-compute[74080]:       </nova:owner>
Oct 16 07:47:41 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:47:41 user nova-compute[74080]:       <nova:ports>
Oct 16 07:47:41 user nova-compute[74080]:         <nova:port uuid="4a6b5e9d-7a95-40e7-b890-e9500d69d682">
Oct 16 07:47:41 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 07:47:41 user nova-compute[74080]:         </nova:port>
Oct 16 07:47:41 user nova-compute[74080]:       </nova:ports>
Oct 16 07:47:41 user nova-compute[74080]:     </nova:instance>
Oct 16 07:47:41 user nova-compute[74080]:   </metadata>
Oct 16 07:47:41 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:47:41 user nova-compute[74080]:     <system>
Oct 16 07:47:41 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:47:41 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:47:41 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:47:41 user nova-compute[74080]:       <entry name="serial">fa351f45-3a41-4f50-b38e-62c8a5bacbdd</entry>
Oct 16 07:47:41 user nova-compute[74080]:       <entry name="uuid">fa351f45-3a41-4f50-b38e-62c8a5bacbdd</entry>
Oct 16 07:47:41 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:47:41 user nova-compute[74080]:     </system>
Oct 16 07:47:41 user nova-compute[74080]:   </sysinfo>
Oct 16 07:47:41 user nova-compute[74080]:   <os>
Oct 16 07:47:41 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:47:41 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:47:41 user nova-compute[74080]:   </os>
Oct 16 07:47:41 user nova-compute[74080]:   <features>
Oct 16 07:47:41 user nova-compute[74080]:     <acpi/>
Oct 16 07:47:41 user nova-compute[74080]:     <apic/>
Oct 16 07:47:41 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:47:41 user nova-compute[74080]:   </features>
Oct 16 07:47:41 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:47:41 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:47:41 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:47:41 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:47:41 user nova-compute[74080]:   </clock>
Oct 16 07:47:41 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:47:41 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:47:41 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:47:41 user nova-compute[74080]:   </cpu>
Oct 16 07:47:41 user nova-compute[74080]:   <devices>
Oct 16 07:47:41 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:47:41 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:47:41 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.rescue"/>
Oct 16 07:47:41 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:47:41 user nova-compute[74080]:     </disk>
Oct 16 07:47:41 user nova-compute[74080]:     <disk type="file" device="disk">
Oct 16 07:47:41 user nova-compute[74080]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 07:47:41 user nova-compute[74080]:       <source file="/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk"/>
Oct 16 07:47:41 user nova-compute[74080]:       <target dev="vdb" bus="virtio"/>
Oct 16 07:47:41 user nova-compute[74080]:     </disk>
Oct 16 07:47:41 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:47:41 user nova-compute[74080]:       <mac address="fa:16:3e:b6:ce:e4"/>
Oct 16 07:47:41 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:47:41 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:47:41 user nova-compute[74080]:       <target dev="tap4a6b5e9d-7a"/>
Oct 16 07:47:41 user nova-compute[74080]:     </interface>
Oct 16 07:47:41 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:47:41 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/console.log" append="off"/>
Oct 16 07:47:41 user nova-compute[74080]:     </serial>
Oct 16 07:47:41 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:47:41 user nova-compute[74080]:     <video>
Oct 16 07:47:41 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:47:41 user nova-compute[74080]:     </video>
Oct 16 07:47:41 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:47:41 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:47:41 user nova-compute[74080]:     </rng>
Oct 16 07:47:41 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:47:41 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:47:41 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:47:41 user nova-compute[74080]:     </memballoon>
Oct 16 07:47:41 user nova-compute[74080]:   </devices>
Oct 16 07:47:41 user nova-compute[74080]: </domain>
Oct 16 07:47:41 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:47:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Instance destroyed successfully.
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] No VIF found with MAC fa:16:3e:b6:ce:e4, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:41 user nova-compute[74080]: INFO nova.compute.manager [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Terminating instance
Oct 16 07:47:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:41 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-19c01773-4c52-4cb9-9dd0-99f3da41fd10 req-fb1ac01b-9124-4bc7-8fef-6f65cb14fe37 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-vif-unplugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-19c01773-4c52-4cb9-9dd0-99f3da41fd10 req-fb1ac01b-9124-4bc7-8fef-6f65cb14fe37 service nova] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-19c01773-4c52-4cb9-9dd0-99f3da41fd10 req-fb1ac01b-9124-4bc7-8fef-6f65cb14fe37 service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-19c01773-4c52-4cb9-9dd0-99f3da41fd10 req-fb1ac01b-9124-4bc7-8fef-6f65cb14fe37 service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-19c01773-4c52-4cb9-9dd0-99f3da41fd10 req-fb1ac01b-9124-4bc7-8fef-6f65cb14fe37 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] No waiting events found dispatching network-vif-unplugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-19c01773-4c52-4cb9-9dd0-99f3da41fd10 req-fb1ac01b-9124-4bc7-8fef-6f65cb14fe37 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-vif-unplugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-1d867471-4050-4ff8-8823-95cd091ddd91 req-77e39e12-449d-4121-8e7c-30063ac2bfd1 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1d867471-4050-4ff8-8823-95cd091ddd91 req-77e39e12-449d-4121-8e7c-30063ac2bfd1 service nova] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1d867471-4050-4ff8-8823-95cd091ddd91 req-77e39e12-449d-4121-8e7c-30063ac2bfd1 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-1d867471-4050-4ff8-8823-95cd091ddd91 req-77e39e12-449d-4121-8e7c-30063ac2bfd1 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:42 user nova-compute[74080]: DEBUG nova.compute.manager [req-1d867471-4050-4ff8-8823-95cd091ddd91 req-77e39e12-449d-4121-8e7c-30063ac2bfd1 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] No waiting events found dispatching network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:42 user nova-compute[74080]: WARNING nova.compute.manager [req-1d867471-4050-4ff8-8823-95cd091ddd91 req-77e39e12-449d-4121-8e7c-30063ac2bfd1 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received unexpected event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 for instance with vm_state active and task_state rescuing.
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Instance destroyed successfully.
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.objects.instance [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lazy-loading 'resources' on Instance uuid 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1455862404',display_name='tempest-AttachVolumeTestJSON-server-1455862404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1455862404',id=34,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx2bsJOy5Jh4F2Vns3/T0nhCci00q88enGb4/8EFTk7d3V6/mW8Haj4Ungk0lY+xtnUPzVQs45jLGCCBTAqKHUF7YtZpLoHMwTsfXQ2Pq+wpqwPKZLxDNRMT+qI6vRJgQ==',key_name='tempest-keypair-690391574',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:44:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c87d6996a3e46d19f45367113c987c9',ramdisk_id='',reservation_id='r-kf5cbci7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1619996160',owner_user_name='tempest-AttachVolumeTestJSON-1619996160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e555075cd0d49f9af33eb6ebfe8d55a',uuid=99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converting VIF {"id": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "address": "fa:16:3e:42:13:c2", "network": {"id": "40442f92-60bf-47f4-9b11-be63074686ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-974525716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c87d6996a3e46d19f45367113c987c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6310f7ae-bb", "ovs_interfaceid": "6310f7ae-bb5b-4bcb-9eff-e1c20483e948", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:13:c2,bridge_name='br-int',has_traffic_filtering=True,id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6310f7ae-bb') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG os_vif [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:13:c2,bridge_name='br-int',has_traffic_filtering=True,id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6310f7ae-bb') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6310f7ae-bb, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddf76519-f5bb-433f-a020-6bfd4de59882) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: INFO os_vif [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:13:c2,bridge_name='br-int',has_traffic_filtering=True,id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948,network=Network(40442f92-60bf-47f4-9b11-be63074686ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6310f7ae-bb')
Oct 16 07:47:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Deleting instance files /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f_del
Oct 16 07:47:43 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Deletion of /opt/stack/data/nova/instances/99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f_del complete
Oct 16 07:47:43 user nova-compute[74080]: INFO nova.compute.manager [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Took 1.59 seconds to destroy the instance on the hypervisor.
Oct 16 07:47:43 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Starting instance... {{(pid=74080) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:43 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:47:43 user nova-compute[74080]: INFO nova.compute.claims [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Claim successful on node user
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-2d71afcd-f3a0-4a12-8aea-1fce0588ac36 req-894b0c6a-4b89-4d75-b998-82814bbf9d16 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2d71afcd-f3a0-4a12-8aea-1fce0588ac36 req-894b0c6a-4b89-4d75-b998-82814bbf9d16 service nova] Acquiring lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2d71afcd-f3a0-4a12-8aea-1fce0588ac36 req-894b0c6a-4b89-4d75-b998-82814bbf9d16 service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2d71afcd-f3a0-4a12-8aea-1fce0588ac36 req-894b0c6a-4b89-4d75-b998-82814bbf9d16 service nova] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-2d71afcd-f3a0-4a12-8aea-1fce0588ac36 req-894b0c6a-4b89-4d75-b998-82814bbf9d16 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] No waiting events found dispatching network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:44 user nova-compute[74080]: WARNING nova.compute.manager [req-2d71afcd-f3a0-4a12-8aea-1fce0588ac36 req-894b0c6a-4b89-4d75-b998-82814bbf9d16 service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received unexpected event network-vif-plugged-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 for instance with vm_state active and task_state deleting.
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:44 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Took 0.92 seconds to deallocate network for instance.
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-117464b9-2b2e-42f7-a45a-c935d2055e0f req-722c8653-b040-43c8-ba00-5333e5623d6a service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Received event network-vif-deleted-6310f7ae-bb5b-4bcb-9eff-e1c20483e948 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:44 user nova-compute[74080]: INFO nova.compute.manager [req-117464b9-2b2e-42f7-a45a-c935d2055e0f req-722c8653-b040-43c8-ba00-5333e5623d6a service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Neutron deleted interface 6310f7ae-bb5b-4bcb-9eff-e1c20483e948; detaching it from the instance and deleting it from the info cache
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.network.neutron [req-117464b9-2b2e-42f7-a45a-c935d2055e0f req-722c8653-b040-43c8-ba00-5333e5623d6a service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-117464b9-2b2e-42f7-a45a-c935d2055e0f req-722c8653-b040-43c8-ba00-5333e5623d6a service nova] [instance: 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f] Detach interface failed, port_id=6310f7ae-bb5b-4bcb-9eff-e1c20483e948, reason: Instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f could not be found. {{(pid=74080) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Start building networks asynchronously for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.189s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Allocating IP information in the background. {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.network.neutron [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] allocate_for_instance() {{(pid=74080) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] No waiting events found dispatching network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:44 user nova-compute[74080]: WARNING nova.compute.manager [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received unexpected event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 for instance with vm_state active and task_state rescuing.
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] Acquiring lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] Lock "fa351f45-3a41-4f50-b38e-62c8a5bacbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] No waiting events found dispatching network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:44 user nova-compute[74080]: WARNING nova.compute.manager [req-d3109bb6-f649-44ed-ace0-24d2bd957b73 req-4711f932-77dd-4913-aa90-7dfef96546e5 service nova] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Received unexpected event network-vif-plugged-4a6b5e9d-7a95-40e7-b890-e9500d69d682 for instance with vm_state active and task_state rescuing.
Oct 16 07:47:44 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Start building block device mappings for instance. {{(pid=74080) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 07:47:44 user nova-compute[74080]: INFO nova.virt.block_device [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Booting with volume-backed-image f8d6ec0a-e025-4b3f-8896-9e692aff07e8 at /dev/vda
Oct 16 07:47:44 user nova-compute[74080]: DEBUG nova.policy [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf2fbffe5a5544dba338662d437d5ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea8d62574f84ae6a83ee19b7b03c21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74080) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 07:47:45 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:47:45 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:47:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.568s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:45 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Deleted allocations for instance 99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f
Oct 16 07:47:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-7309ebf6-9047-4e64-815e-32d7957f88d9 tempest-AttachVolumeTestJSON-1619996160 tempest-AttachVolumeTestJSON-1619996160-project-member] Lock "99112ac2-4fe4-4ac0-8287-9a9c4ba8b22f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:45 user nova-compute[74080]: DEBUG nova.compute.manager [None req-dd24447f-0f15-4c17-a070-e00a24f37408 tempest-ServerRescueNegativeTestJSON-2029305131 tempest-ServerRescueNegativeTestJSON-2029305131-project-member] [instance: fa351f45-3a41-4f50-b38e-62c8a5bacbdd] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:47:45 user nova-compute[74080]: DEBUG nova.network.neutron [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Successfully created port: 32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Successfully updated port: 32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "refresh_cache-1bbb6b64-9bad-4d7d-820a-60ea529f4135" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquired lock "refresh_cache-1bbb6b64-9bad-4d7d-820a-60ea529f4135" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Received event network-changed-32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Refreshing instance network info cache due to event network-changed-32dcc8e2-99aa-4580-b8a8-1b0f04898fec. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] Acquiring lock "refresh_cache-1bbb6b64-9bad-4d7d-820a-60ea529f4135" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Instance cache missing network info. {{(pid=74080) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.network.neutron [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Updating instance_info_cache with network_info: [{"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Releasing lock "refresh_cache-1bbb6b64-9bad-4d7d-820a-60ea529f4135" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Instance network_info: |[{"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74080) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] Acquired lock "refresh_cache-1bbb6b64-9bad-4d7d-820a-60ea529f4135" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Refreshing network info cache for port 32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:47:47 user nova-compute[74080]: DEBUG nova.network.neutron [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Updated VIF entry in instance network info cache for port 32dcc8e2-99aa-4580-b8a8-1b0f04898fec. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:47:47 user nova-compute[74080]: DEBUG nova.network.neutron [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Updating instance_info_cache with network_info: [{"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-b369c5d8-cbb4-4fc6-8ba3-4332aaed4ac1 req-cdc8dcb4-d96a-4c1e-9076-562811081142 service nova] Releasing lock "refresh_cache-1bbb6b64-9bad-4d7d-820a-60ea529f4135" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:49 user nova-compute[74080]: INFO nova.compute.manager [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Terminating instance
Oct 16 07:47:49 user nova-compute[74080]: DEBUG nova.compute.manager [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Start destroying the instance on the hypervisor. {{(pid=74080) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-87a2f031-b59d-45fd-801f-1239ee0cc87f req-47c5b6c1-9824-4936-8bb9-397c29441e6e service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87a2f031-b59d-45fd-801f-1239ee0cc87f req-47c5b6c1-9824-4936-8bb9-397c29441e6e service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87a2f031-b59d-45fd-801f-1239ee0cc87f req-47c5b6c1-9824-4936-8bb9-397c29441e6e service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-87a2f031-b59d-45fd-801f-1239ee0cc87f req-47c5b6c1-9824-4936-8bb9-397c29441e6e service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-87a2f031-b59d-45fd-801f-1239ee0cc87f req-47c5b6c1-9824-4936-8bb9-397c29441e6e service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-87a2f031-b59d-45fd-801f-1239ee0cc87f req-47c5b6c1-9824-4936-8bb9-397c29441e6e service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-unplugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with task_state deleting. {{(pid=74080) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 07:47:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Instance destroyed successfully.
Oct 16 07:47:50 user nova-compute[74080]: DEBUG nova.objects.instance [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lazy-loading 'resources' on Instance uuid b50a04d5-3359-4be0-879a-0fc018b0ed3e {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-249230266',display_name='tempest-ServerStableDeviceRescueTest-server-249230266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-249230266',id=29,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnrYUgnNVaIXWMKCVNKUFovEiNpR42onkWyuP6mKDHHvFakfyOXGpH8jYZWabe2WfukXV1HmPadf31ItRgy/Ki2t1dXenFXypK+V2OhzZvGEAzuJYEOiEqtCecaqZQXrQ==',key_name='tempest-keypair-687037286',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:44:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73dfaec529db4de28029e7186f4dc99f',ramdisk_id='',reservation_id='r-lkd9yen0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1785898129',owner_user_name='tempest-ServerStableDeviceRescueTest-1785898129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:46:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a7347ee6d924888a4ba0eae614a2798',uuid=b50a04d5-3359-4be0-879a-0fc018b0ed3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converting VIF {"id": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "address": "fa:16:3e:f1:12:22", "network": {"id": "e3acb5f0-50e6-42f0-978c-f4c2ee68bc19", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1714578135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73dfaec529db4de28029e7186f4dc99f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5f6c16f-cc", "ovs_interfaceid": "d5f6c16f-cc65-486c-a75e-06889c7b1d9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG os_vif [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5f6c16f-cc, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2a118e7-c719-421e-900e-328ab4d981f8) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:50 user nova-compute[74080]: INFO os_vif [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:12:22,bridge_name='br-int',has_traffic_filtering=True,id=d5f6c16f-cc65-486c-a75e-06889c7b1d9f,network=Network(e3acb5f0-50e6-42f0-978c-f4c2ee68bc19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5f6c16f-cc')
Oct 16 07:47:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Deleting instance files /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e_del
Oct 16 07:47:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Deletion of /opt/stack/data/nova/instances/b50a04d5-3359-4be0-879a-0fc018b0ed3e_del complete
Oct 16 07:47:50 user nova-compute[74080]: INFO nova.compute.manager [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Took 1.09 seconds to destroy the instance on the hypervisor.
Oct 16 07:47:50 user nova-compute[74080]: DEBUG oslo.service.loopingcall [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74080) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG nova.compute.manager [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Deallocating network for instance {{(pid=74080) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 07:47:50 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] deallocate_for_instance() {{(pid=74080) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG nova.network.neutron [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Updating instance_info_cache with network_info: [] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:51 user nova-compute[74080]: INFO nova.compute.manager [-] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Took 0.90 seconds to deallocate network for instance.
Oct 16 07:47:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:51 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Deleted allocations for instance b50a04d5-3359-4be0-879a-0fc018b0ed3e
Oct 16 07:47:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-c9c874cb-e802-4357-b5c4-04225234808d req-16a0e5cd-5175-4902-b320-0c06b148b34c service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c9c874cb-e802-4357-b5c4-04225234808d req-16a0e5cd-5175-4902-b320-0c06b148b34c service nova] Acquiring lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c9c874cb-e802-4357-b5c4-04225234808d req-16a0e5cd-5175-4902-b320-0c06b148b34c service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c9c874cb-e802-4357-b5c4-04225234808d req-16a0e5cd-5175-4902-b320-0c06b148b34c service nova] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-c9c874cb-e802-4357-b5c4-04225234808d req-16a0e5cd-5175-4902-b320-0c06b148b34c service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] No waiting events found dispatching network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:47:51 user nova-compute[74080]: WARNING nova.compute.manager [req-c9c874cb-e802-4357-b5c4-04225234808d req-16a0e5cd-5175-4902-b320-0c06b148b34c service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received unexpected event network-vif-plugged-d5f6c16f-cc65-486c-a75e-06889c7b1d9f for instance with vm_state deleted and task_state None.
Oct 16 07:47:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-c9c874cb-e802-4357-b5c4-04225234808d req-16a0e5cd-5175-4902-b320-0c06b148b34c service nova] [instance: b50a04d5-3359-4be0-879a-0fc018b0ed3e] Received event network-vif-deleted-d5f6c16f-cc65-486c-a75e-06889c7b1d9f {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-4419a435-53a8-4fc5-a75b-4ca82685bb39 tempest-ServerStableDeviceRescueTest-1785898129 tempest-ServerStableDeviceRescueTest-1785898129-project-member] Lock "b50a04d5-3359-4be0-879a-0fc018b0ed3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:53 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:54 user nova-compute[74080]: DEBUG nova.compute.manager [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received event network-changed-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:54 user nova-compute[74080]: DEBUG nova.compute.manager [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Refreshing instance network info cache due to event network-changed-b07683df-b70a-4078-a943-b84cf8923016. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:47:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] Acquiring lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:54 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] Acquired lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:54 user nova-compute[74080]: DEBUG nova.network.neutron [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Refreshing network info cache for port b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG nova.network.neutron [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updated VIF entry in instance network info cache for port b07683df-b70a-4078-a943-b84cf8923016. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG nova.network.neutron [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updating instance_info_cache with network_info: [{"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-701d4169-5629-4600-a472-5b8b0abb4fe9 req-2f88b29f-01bf-4cf9-b121-31a789065465 service nova] Releasing lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG nova.compute.manager [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing instance network info cache due to event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] Acquiring lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] Acquired lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:55 user nova-compute[74080]: DEBUG nova.network.neutron [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Received event network-changed-4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Refreshing instance network info cache due to event network-changed-4263b4f4-8cc3-43ff-9df6-f1af111a7e63. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] Acquiring lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] Acquired lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.network.neutron [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Refreshing network info cache for port 4263b4f4-8cc3-43ff-9df6-f1af111a7e63 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "816158fd-6a77-4d53-9cdb-09707887bafe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:56 user nova-compute[74080]: INFO nova.compute.manager [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Detaching volume 29473c7b-f697-4e14-8109-cf169fd7de33
Oct 16 07:47:56 user nova-compute[74080]: INFO nova.virt.block_device [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Attempting to driver detach volume 29473c7b-f697-4e14-8109-cf169fd7de33 from mountpoint /dev/vdb
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Attempting to detach device vdb from instance 816158fd-6a77-4d53-9cdb-09707887bafe from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:47:56 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:47:56 user nova-compute[74080]:   <source dev="/dev/sdd"/>
Oct 16 07:47:56 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:47:56 user nova-compute[74080]:   <serial>29473c7b-f697-4e14-8109-cf169fd7de33</serial>
Oct 16 07:47:56 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:47:56 user nova-compute[74080]: </disk>
Oct 16 07:47:56 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:47:56 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully detached device vdb from instance 816158fd-6a77-4d53-9cdb-09707887bafe from the persistent domain config.
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 816158fd-6a77-4d53-9cdb-09707887bafe from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:47:56 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:47:56 user nova-compute[74080]:   <source dev="/dev/sdd"/>
Oct 16 07:47:56 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:47:56 user nova-compute[74080]:   <serial>29473c7b-f697-4e14-8109-cf169fd7de33</serial>
Oct 16 07:47:56 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:47:56 user nova-compute[74080]: </disk>
Oct 16 07:47:56 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "7b61eeb2-de2e-498d-b307-852473aadb01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'flavor' on Instance uuid 7b61eeb2-de2e-498d-b307-852473aadb01 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.network.neutron [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updated VIF entry in instance network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.network.neutron [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating instance_info_cache with network_info: [{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2005519d-77e3-4597-948e-9bafea5f020b req-db551fef-ad79-4399-afbb-3ad46f1293c9 service nova] Releasing lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "7b61eeb2-de2e-498d-b307-852473aadb01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:47:56 user nova-compute[74080]: INFO nova.compute.manager [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Attaching volume f4424567-bc52-4c80-92a9-52462876011a to /dev/vdb
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Received event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.compute.manager [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing instance network info cache due to event network-changed-6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] Acquiring lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] Acquired lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.network.neutron [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Refreshing network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG os_brick.utils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[89986ba9-9b59-4981-80d7-f030ba027db9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fecd23-0f7c-4ee8-a829-52febf8f441e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0162bd-7784-40b6-84c4-b0ea267d263f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fbdc18-2230-4971-a524-c89f0578dd10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.network.neutron [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Updated VIF entry in instance network info cache for port 4263b4f4-8cc3-43ff-9df6-f1af111a7e63. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:47:56 user nova-compute[74080]: DEBUG nova.network.neutron [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Updating instance_info_cache with network_info: [{"id": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "address": "fa:16:3e:ad:72:b6", "network": {"id": "14fc4b49-2409-48da-b1d2-9e3a5df62aa0", "bridge": "br-int", "label": "tempest-TestStampPattern-1548531205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be593890c024a4bac126c56f5fa8468", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4263b4f4-8c", "ovs_interfaceid": "4263b4f4-8cc3-43ff-9df6-f1af111a7e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 816158fd-6a77-4d53-9cdb-09707887bafe {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-5295ee98-c50f-4442-89ed-b2d45213fe3f req-6d01754e-9353-48f0-bb64-6c3005fc6a9d service nova] Releasing lock "refresh_cache-7b61eeb2-de2e-498d-b307-852473aadb01" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:47:57 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:47:57 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce157238-fc78-4778-969f-32c50df412e1]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG os_brick.utils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Updating existing volume attachment record: 6e4d77a6-984c-48de-9307-f48e94ab0731 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updated VIF entry in instance network info cache for port 6508e90b-0fb8-4d94-9a47-71a6217e8cfb. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG nova.network.neutron [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Updating instance_info_cache with network_info: [{"id": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "address": "fa:16:3e:eb:37:6e", "network": {"id": "c1170523-f6ce-4940-8eac-796de898d7a1", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-641393398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c9d95219a244140a28a733edb91013b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6508e90b-0f", "ovs_interfaceid": "6508e90b-0fb8-4d94-9a47-71a6217e8cfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:47:57 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-07031d33-8aae-411f-b2a9-753acb604e28 req-a55305b8-02e9-4494-8f33-2c82b52382d5 service nova] Releasing lock "refresh_cache-816158fd-6a77-4d53-9cdb-09707887bafe" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:47:58 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:00 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:03 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:05 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:08 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:10 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "90178686-25e3-4659-8c41-adbc6fb83d63" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:11 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "90178686-25e3-4659-8c41-adbc6fb83d63" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:11 user nova-compute[74080]: INFO nova.compute.manager [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Shelving
Oct 16 07:48:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:11 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-72d3cfdb-674d-44d1-b4fb-b2c68f74b358 req-b66671d4-3aec-41dd-8c5f-9c5256112958 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received event network-vif-unplugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-72d3cfdb-674d-44d1-b4fb-b2c68f74b358 req-b66671d4-3aec-41dd-8c5f-9c5256112958 service nova] Acquiring lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-72d3cfdb-674d-44d1-b4fb-b2c68f74b358 req-b66671d4-3aec-41dd-8c5f-9c5256112958 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:12 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-72d3cfdb-674d-44d1-b4fb-b2c68f74b358 req-b66671d4-3aec-41dd-8c5f-9c5256112958 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:12 user nova-compute[74080]: DEBUG nova.compute.manager [req-72d3cfdb-674d-44d1-b4fb-b2c68f74b358 req-b66671d4-3aec-41dd-8c5f-9c5256112958 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] No waiting events found dispatching network-vif-unplugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:48:12 user nova-compute[74080]: WARNING nova.compute.manager [req-72d3cfdb-674d-44d1-b4fb-b2c68f74b358 req-b66671d4-3aec-41dd-8c5f-9c5256112958 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received unexpected event network-vif-unplugged-b07683df-b70a-4078-a943-b84cf8923016 for instance with vm_state active and task_state shelving.
Oct 16 07:48:12 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Instance destroyed successfully.
Oct 16 07:48:12 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Beginning cold snapshot process
Oct 16 07:48:12 user nova-compute[74080]: DEBUG nova.privsep.utils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74080) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 07:48:12 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk /opt/stack/data/nova/instances/snapshots/tmpr5p3jvh9/e3dc95d7a24944ad9ce7d23cb5b94db4 {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVMDognI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:48:13 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:48:13 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:48:13 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[582da79d-9556-4379-af37-73e330b40b8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:48:13 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[70facc7b-ab17-415b-a225-b11ddda9dd8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a] added
Oct 16 07:48:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dbf387-fca8-41e6-9e60-759a24c5ec3b]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf99f18f-f08d-4e42-a906-4681f7d66537]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVMDognI {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVMDognI" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5dbcd-5d8f-49e7-9e7f-f328e74cb0bc]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TVMDognI'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c157643-496a-40bb-8160-9e096807c31a]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32330d1-7b33-4745-8bc6-4b1531a64338]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e7547-e392-4536-8229-80694600f321]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260]
Oct 16 07:48:13 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260] successful.
Oct 16 07:48:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbeadc-4fd7-49d0-812b-882b54694ef6]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b4eabb-d027-4358-9d5d-83802d61b15f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)
Oct 16 07:48:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:13 user nova-compute[74080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)
Oct 16 07:48:13 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] HCTL ('38', '-', '-', 0) found on session 49 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63/disk /opt/stack/data/nova/instances/snapshots/tmpr5p3jvh9/e3dc95d7a24944ad9ce7d23cb5b94db4" returned: 0 in 1.053s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Snapshot extracted, beginning image upload
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c122867-0b7c-4a4e-99b6-50ad2522731f]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:13 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-9fe84174-707f-4be0-a061-16a8ba26e0ff req-143c9b22-3b73-4f23-aceb-42dc0cf0e646 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received event network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9fe84174-707f-4be0-a061-16a8ba26e0ff req-143c9b22-3b73-4f23-aceb-42dc0cf0e646 service nova] Acquiring lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9fe84174-707f-4be0-a061-16a8ba26e0ff req-143c9b22-3b73-4f23-aceb-42dc0cf0e646 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-9fe84174-707f-4be0-a061-16a8ba26e0ff req-143c9b22-3b73-4f23-aceb-42dc0cf0e646 service nova] Lock "90178686-25e3-4659-8c41-adbc6fb83d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.compute.manager [req-9fe84174-707f-4be0-a061-16a8ba26e0ff req-143c9b22-3b73-4f23-aceb-42dc0cf0e646 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] No waiting events found dispatching network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:48:14 user nova-compute[74080]: WARNING nova.compute.manager [req-9fe84174-707f-4be0-a061-16a8ba26e0ff req-143c9b22-3b73-4f23-aceb-42dc0cf0e646 service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received unexpected event network-vif-plugged-b07683df-b70a-4078-a943-b84cf8923016 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 07:48:14 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Searching for a device in session 49 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVMDognI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23935623266343330', 'path': '/dev/sdg'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935623266343330', 'path': '/dev/sdg'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.objects.instance [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'flavor' on Instance uuid 7b61eeb2-de2e-498d-b307-852473aadb01 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 07:48:14 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:48:14 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:48:14 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:48:14 user nova-compute[74080]:   <serial>f4424567-bc52-4c80-92a9-52462876011a</serial>
Oct 16 07:48:14 user nova-compute[74080]: </disk>
Oct 16 07:48:14 user nova-compute[74080]:  {{(pid=74080) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:48:14 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] No VIF found with MAC fa:16:3e:ad:72:b6, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e109eb8e-9286-48a3-9ade-1da26068b926 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.362s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG os_brick.utils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b673ea-b3af-4faf-b6a7-b9582c21e673]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd07aa64-b016-48a4-8a5e-4175972f1d32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[616c255c-e13b-45fa-a8c3-45f6080ed567]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba33832-6c00-40f4-b824-c2a3019f63fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:48:15 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:48:15 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189bbaf-b77f-43d4-a6b6-20c2df2e3099]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG os_brick.utils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:48:15 user nova-compute[74080]: DEBUG nova.virt.block_device [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Updating existing volume attachment record: 4f561f1d-163c-440c-945d-c0de61e18959 {{(pid=74080) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 07:48:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Snapshot image upload complete
Oct 16 07:48:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:48:16 user nova-compute[74080]: INFO nova.compute.manager [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Shelve offloading
Oct 16 07:48:16 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Instance destroyed successfully.
Oct 16 07:48:16 user nova-compute[74080]: DEBUG nova.compute.manager [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:48:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:48:16 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquired lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:48:16 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:48:17 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 816158fd-6a77-4d53-9cdb-09707887bafe is timed out.
Oct 16 07:48:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Successfully detached device vdb from instance 816158fd-6a77-4d53-9cdb-09707887bafe from the live domain config.
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oruEazCJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:48:17 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00a919b-5b49-4e85-b14e-22fba4ef8ce0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:48:17 user nova-compute[74080]: No targets found.
Oct 16 07:48:17 user nova-compute[74080]: iSNS:
Oct 16 07:48:17 user nova-compute[74080]: No targets found.
Oct 16 07:48:17 user nova-compute[74080]: STATIC:
Oct 16 07:48:17 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a
Oct 16 07:48:17 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:17 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:17 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:48:17 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:17 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:17 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84
Oct 16 07:48:17 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:17 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:17 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33
Oct 16 07:48:17 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:17 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:17 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1
Oct 16 07:48:17 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:17 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:17 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a
Oct 16 07:48:17 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:17 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:17 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043
Oct 16 07:48:17 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:17 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:17 user nova-compute[74080]: FIRMWARE:
Oct 16 07:48:17 user nova-compute[74080]: No targets found.
Oct 16 07:48:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:48:17 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:48:17 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ae550-17ac-4490-baf2-df3259c2f192]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2c3b96-20a1-40f8-b409-4f44a62ca9fe]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)
Oct 16 07:48:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:17 user nova-compute[74080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)
Oct 16 07:48:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7c42508b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33'): ({'sdd'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Removing single pathed devices sdd {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f927ae3c-e8ba-472f-8280-31e452fd216e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c86213-f8c5-4df8-aaa6-5962b50deed6]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Flushing IO for device /dev/sdd {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadafad5-e106-43f3-9cc5-135560565eba]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae9fa2d-c16b-4082-a45d-ca0f52a576a0]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] SCSI volumes sdd have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.network.neutron [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updating instance_info_cache with network_info: [{"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24c52c1-e97d-4956-8eda-5099fceff313]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Releasing lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea31143-2463-4801-ad08-e1d12698db53]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260]
Oct 16 07:48:17 user nova-compute[74080]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33, portal: 172.16.0.220,3260] successful.
Oct 16 07:48:17 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29473c7b-f697-4e14-8109-cf169fd7de33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e83ed7-0a7f-4aee-aefc-e4ffde4bc134]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] <== disconnect_volume: return (364ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] [instance: 816158fd-6a77-4d53-9cdb-09707887bafe] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "7b61eeb2-de2e-498d-b307-852473aadb01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:17 user nova-compute[74080]: INFO nova.compute.manager [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Detaching volume f4424567-bc52-4c80-92a9-52462876011a
Oct 16 07:48:17 user nova-compute[74080]: INFO nova.virt.block_device [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Attempting to driver detach volume f4424567-bc52-4c80-92a9-52462876011a from mountpoint /dev/vdb
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Attempting to detach device vdb from instance 7b61eeb2-de2e-498d-b307-852473aadb01 from the persistent domain config. {{(pid=74080) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:48:17 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:48:17 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:48:17 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:48:17 user nova-compute[74080]:   <serial>f4424567-bc52-4c80-92a9-52462876011a</serial>
Oct 16 07:48:17 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:48:17 user nova-compute[74080]: </disk>
Oct 16 07:48:17 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:48:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Successfully detached device vdb from instance 7b61eeb2-de2e-498d-b307-852473aadb01 from the persistent domain config.
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b61eeb2-de2e-498d-b307-852473aadb01 from the live domain config. {{(pid=74080) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.guest [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 07:48:17 user nova-compute[74080]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:48:17 user nova-compute[74080]:   <source dev="/dev/sdg"/>
Oct 16 07:48:17 user nova-compute[74080]:   <target dev="vdb" bus="virtio"/>
Oct 16 07:48:17 user nova-compute[74080]:   <serial>f4424567-bc52-4c80-92a9-52462876011a</serial>
Oct 16 07:48:17 user nova-compute[74080]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 07:48:17 user nova-compute[74080]: </disk>
Oct 16 07:48:17 user nova-compute[74080]:  {{(pid=74080) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 07:48:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Instance destroyed successfully.
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'resources' on Instance uuid 90178686-25e3-4659-8c41-adbc6fb83d63 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-679793859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-679793859',id=38,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWhxkfuu6xvJnghzRZZ737A58JYsbtQCHTfH+owxrpU2wVCtryw1Bksx0dTRzVL+XxNM6plAQdbhKP0b5MjEX3WcblJXq8dA9PFStrdse3MAMWNS23NlkOCJ+39ghO5UA==',key_name='tempest-keypair-305204350',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:46:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cb49371c30764797a229c88006622241',ramdisk_id='',reservation_id='r-ioghq4po',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2100146647',owner_user_name='tempest-AttachVolumeShelveTestJSON-2100146647-project-member',shelved_at='2023-10-16T07:48:16.078521',shelved_host='user',shelved_image_id='b76f4895-7ffc-487a-9b68-ba7532ee6a8f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T07:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db721d9235c64087bf54998e468b7f3e',uuid=90178686-25e3-4659-8c41-adbc6fb83d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converting VIF {"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07683df-b7", "ovs_interfaceid": "b07683df-b70a-4078-a943-b84cf8923016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=b07683df-b70a-4078-a943-b84cf8923016,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07683df-b7') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG os_vif [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=b07683df-b70a-4078-a943-b84cf8923016,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07683df-b7') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb07683df-b7, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8d8cef1-4c70-405f-b239-112a7b83e9e2) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:17 user nova-compute[74080]: INFO os_vif [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:29:3e,bridge_name='br-int',has_traffic_filtering=True,id=b07683df-b70a-4078-a943-b84cf8923016,network=Network(30511e53-4b62-4fb8-9ea5-3c45b8903ad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07683df-b7')
Oct 16 07:48:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Deleting instance files /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63_del
Oct 16 07:48:17 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Deletion of /opt/stack/data/nova/instances/90178686-25e3-4659-8c41-adbc6fb83d63_del complete
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Received event network-changed-b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.compute.manager [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Refreshing instance network info cache due to event network-changed-b07683df-b70a-4078-a943-b84cf8923016. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] Acquiring lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] Acquired lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:48:17 user nova-compute[74080]: DEBUG nova.network.neutron [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Refreshing network info cache for port b07683df-b70a-4078-a943-b84cf8923016 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:48:18 user nova-compute[74080]: INFO nova.scheduler.client.report [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Deleted allocations for instance 90178686-25e3-4659-8c41-adbc6fb83d63
Oct 16 07:48:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lazy-loading 'numa_topology' on Instance uuid 90178686-25e3-4659-8c41-adbc6fb83d63 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.objects.base [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Object Instance<90178686-25e3-4659-8c41-adbc6fb83d63> lazy-loaded attributes: resources,numa_topology {{(pid=74080) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b61eeb2-de2e-498d-b307-852473aadb01 {{(pid=74080) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.objects.instance [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lazy-loading 'flavor' on Instance uuid 816158fd-6a77-4d53-9cdb-09707887bafe {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-f30de1a6-7654-4e8d-b544-78b9852dce16 tempest-TestMinimumBasicScenario-1785188875 tempest-TestMinimumBasicScenario-1785188875-project-member] Lock "816158fd-6a77-4d53-9cdb-09707887bafe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.203s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.network.neutron [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updated VIF entry in instance network info cache for port b07683df-b70a-4078-a943-b84cf8923016. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.network.neutron [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] [instance: 90178686-25e3-4659-8c41-adbc6fb83d63] Updating instance_info_cache with network_info: [{"id": "b07683df-b70a-4078-a943-b84cf8923016", "address": "fa:16:3e:39:29:3e", "network": {"id": "30511e53-4b62-4fb8-9ea5-3c45b8903ad3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-345343758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb49371c30764797a229c88006622241", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb07683df-b7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-626dfd36-d4a1-4ce4-83e7-9267348c0f91 req-dd64243b-bc0c-4de2-927e-71da3fe2fdbf service nova] Releasing lock "refresh_cache-90178686-25e3-4659-8c41-adbc6fb83d63" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:18 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-6e047e8f-761b-43e4-a8eb-2bf80e850b10 tempest-AttachVolumeShelveTestJSON-2100146647 tempest-AttachVolumeShelveTestJSON-2100146647-project-member] Lock "90178686-25e3-4659-8c41-adbc6fb83d63" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.210s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:20 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:21 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:22 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:25 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:25 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Starting heal instance info cache {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 07:48:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:48:25 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquired lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:48:25 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Forcefully refreshing network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 07:48:25 user nova-compute[74080]: DEBUG nova.network.neutron [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updating instance_info_cache with network_info: [{"id": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "address": "fa:16:3e:eb:93:d2", "network": {"id": "d9cb8ed3-9d63-4f46-bcb6-be660da32755", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2085434908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "479d15d0c8ae430096c24dd442ce1e78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0775ad16-cb", "ovs_interfaceid": "0775ad16-cbd1-4e55-ac5e-669f19cd8f73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:48:26 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Releasing lock "refresh_cache-f0dd4404-980e-42a2-a008-05a90d9a5a05" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:48:26 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] [instance: f0dd4404-980e-42a2-a008-05a90d9a5a05] Updated the network info_cache for instance {{(pid=74080) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 07:48:26 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:26 user nova-compute[74080]: DEBUG nova.compute.manager [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74080) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 07:48:27 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Auditing locally available compute resources for user (node: user) {{(pid=74080) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:28 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d6118bf-0075-4d1c-ad47-c151722a4ad0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /opt/stack/data/nova/instances/fa351f45-3a41-4f50-b38e-62c8a5bacbdd/disk (vdb) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc44f5cc-26d8-4ff2-a868-432143effed3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:48:29 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b61eeb2-de2e-498d-b307-852473aadb01/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:30 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a89c84b-8e61-4290-b4e6-fe1c2bc738e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd394796-510c-4990-aaa7-7f479173c476/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:31 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0dd4404-980e-42a2-a008-05a90d9a5a05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/816158fd-6a77-4d53-9cdb-09707887bafe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:32 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:48:32 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:48:32 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Hypervisor/Node resource view: name=user free_ram=7166MB free_disk=24.734134674072266GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=74080) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:32 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd394796-510c-4990-aaa7-7f479173c476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 4d6118bf-0075-4d1c-ad47-c151722a4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance f0dd4404-980e-42a2-a008-05a90d9a5a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 8a89c84b-8e61-4290-b4e6-fe1c2bc738e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 5a35de85-4095-4a93-8d33-a4577b960b95 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance bc44f5cc-26d8-4ff2-a868-432143effed3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 816158fd-6a77-4d53-9cdb-09707887bafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 16d2ae7a-c34c-46b0-9f31-e29b93b7f0f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 06d935f9-585b-4d7b-aa6e-8bfe7085edd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance fa351f45-3a41-4f50-b38e-62c8a5bacbdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 7b61eeb2-de2e-498d-b307-852473aadb01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 88dbb56c-82a7-46ca-b8eb-808d56b624ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance dd0f5024-3a97-4828-812f-a984414b164d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Instance 1bbb6b64-9bad-4d7d-820a-60ea529f4135 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74080) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74080) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG nova.compute.resource_tracker [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Compute_service record updated for user:user {{(pid=74080) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 07:48:33 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:36 user nova-compute[74080]: DEBUG oslo_service.periodic_task [None req-e5930563-e8e2-4742-89d4-546b93cf1c46 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74080) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 07:48:37 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:48:38 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b61eeb2-de2e-498d-b307-852473aadb01 is timed out.
Oct 16 07:48:38 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Successfully detached device vdb from instance 7b61eeb2-de2e-498d-b307-852473aadb01 from the live domain config.
Oct 16 07:48:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVMDognI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:48:38 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d373c60-068e-411e-aed4-67ac492e8613]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:48:38 user nova-compute[74080]: No targets found.
Oct 16 07:48:38 user nova-compute[74080]: iSNS:
Oct 16 07:48:38 user nova-compute[74080]: No targets found.
Oct 16 07:48:38 user nova-compute[74080]: STATIC:
Oct 16 07:48:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a
Oct 16 07:48:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:48:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84
Oct 16 07:48:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1
Oct 16 07:48:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a
Oct 16 07:48:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:38 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043
Oct 16 07:48:38 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:38 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:38 user nova-compute[74080]: FIRMWARE:
Oct 16 07:48:38 user nova-compute[74080]: No targets found.
Oct 16 07:48:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:48:38 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:48:38 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f666215-2b62-497e-97d0-be7a150814e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[49099aa4-f43a-48d3-a92e-9fe7bb7e8cb2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)
Oct 16 07:48:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:38 user nova-compute[74080]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a (non-flash)
Oct 16 07:48:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7ac3b9a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a'): ({'sdg'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Removing single pathed devices sdg {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5783d4e-c9d4-4bd2-94f3-0f78b6659d5e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[37747f4c-2299-43fa-9cd5-1937babc85fe]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Flushing IO for device /dev/sdg {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0547fd47-562e-4b79-a0eb-277add70a6ea]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b69fa5-fcbe-41be-a97f-7af57dc9a47a]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] SCSI volumes sdg have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a30cc3-446d-4a56-bcab-e9588e6e5880]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9913d3-3ec0-404a-9e52-12dda00b0414]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260]
Oct 16 07:48:38 user nova-compute[74080]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a, portal: 172.16.0.220,3260] successful.
Oct 16 07:48:38 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4424567-bc52-4c80-92a9-52462876011a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b118f2c-42c8-467f-9a4b-12ee268e561c]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] <== disconnect_volume: return (354ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:48:38 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] [instance: 7b61eeb2-de2e-498d-b307-852473aadb01] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:48:39 user nova-compute[74080]: DEBUG nova.objects.instance [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lazy-loading 'flavor' on Instance uuid 7b61eeb2-de2e-498d-b307-852473aadb01 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:48:39 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-0ec3c647-ee35-4728-9f42-dc7b57f215f2 tempest-TestStampPattern-39302602 tempest-TestStampPattern-39302602-project-member] Lock "7b61eeb2-de2e-498d-b307-852473aadb01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.983s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Start spawning the instance on the hypervisor. {{(pid=74080) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Creating instance directory {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 07:48:41 user nova-compute[74080]: INFO nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Creating image(s)
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Did not create local disks {{(pid=74080) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Ensure instance console log exists: /opt/stack/data/nova/instances/1bbb6b64-9bad-4d7d-820a-60ea529f4135/console.log {{(pid=74080) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Start _get_guest_xml network_info=[{"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '4f561f1d-163c-440c-945d-c0de61e18959', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZzsqCUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bbb6b64-9bad-4d7d-820a-60ea529f4135', 'attached_at': '', 'detached_at': '', 'volume_id': '1da84b4a-7806-49f5-a0c3-f4f461d34520', 'serial': '1da84b4a-7806-49f5-a0c3-f4f461d34520'}, 'guest_format': None, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 07:48:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:48:41 user nova-compute[74080]: WARNING nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller missing on host. {{(pid=74080) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.host [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU controller found on host. {{(pid=74080) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74080) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T07:24:24Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T07:24:36Z,direct_url=<?>,disk_format='qcow2',id=f8d6ec0a-e025-4b3f-8896-9e692aff07e8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='7325fbdc962f4417be5888e7e3dc0fc9',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T07:24:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image limits 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Flavor pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Image pref 0:0:0 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74080) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Got 1 possible topologies {{(pid=74080) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74080) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Calling os-brick to attach iSCSI Volume {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZzsqCUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:48:41 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:48:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:48:41 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:48:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:48:41 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:48:41 user nova-compute[74080]: INFO os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 07:48:41 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c1d745-fdbd-4d74-afcf-efceba149439]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 07:48:42 user nova-compute[74080]:  {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --interface default --op new {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[38501711-d3ba-4750-abea-7884ac806b0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520] added\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520] added
Oct 16 07:48:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb0bc33-6d30-469b-8b4f-31bbaf11f716]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b360a2-051e-4f93-9ab7-367b27e81bd3]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZzsqCUK {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hZzsqCUK" returned: 0 in 0.030s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7866efe-0de8-47cf-a51f-8777a1b65886]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hZzsqCUK'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b866977e-1cd8-4f33-91aa-b752eb29cb56]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa6a0f-eb56-46ec-88b7-f7966cb769e6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --login {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b79f833-98f8-47fd-88a8-027d791ed663]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520, portal: 172.16.0.220,3260]
Oct 16 07:48:42 user nova-compute[74080]: Login to [iface: default, target: iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520, portal: 172.16.0.220,3260] successful.
Oct 16 07:48:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65a97cc-5acc-4340-af50-cbdb0ba15a2d]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc2b990-99e8-4e22-9e9d-26457002bbdc]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 (non-flash)
Oct 16 07:48:42 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Connected to 172.16.0.220:3260 {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=74080) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74080) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f304d57-876f-4e74-ab55-32d564f58383]: (4, ('- - 0', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:48:42 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74080) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hZzsqCUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74080) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26438633166663135', 'path': '/dev/sdd'} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438633166663135', 'path': '/dev/sdd'} {{(pid=74080) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-761684220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-761684220',id=42,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-8zxrgj3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:47:45Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=1bbb6b64-9bad-4d7d-820a-60ea529f4135,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74080) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:ad,bridge_name='br-int',has_traffic_filtering=True,id=32dcc8e2-99aa-4580-b8a8-1b0f04898fec,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32dcc8e2-99') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.objects.instance [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bbb6b64-9bad-4d7d-820a-60ea529f4135 {{(pid=74080) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] End _get_guest_xml xml=<domain type="kvm">
Oct 16 07:48:43 user nova-compute[74080]:   <uuid>1bbb6b64-9bad-4d7d-820a-60ea529f4135</uuid>
Oct 16 07:48:43 user nova-compute[74080]:   <name>instance-0000002a</name>
Oct 16 07:48:43 user nova-compute[74080]:   <memory>524288</memory>
Oct 16 07:48:43 user nova-compute[74080]:   <vcpu>1</vcpu>
Oct 16 07:48:43 user nova-compute[74080]:   <metadata>
Oct 16 07:48:43 user nova-compute[74080]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 07:48:43 user nova-compute[74080]:       <nova:package version="0.0.0"/>
Oct 16 07:48:43 user nova-compute[74080]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-761684220</nova:name>
Oct 16 07:48:43 user nova-compute[74080]:       <nova:creationTime>2023-10-16 07:48:41</nova:creationTime>
Oct 16 07:48:43 user nova-compute[74080]:       <nova:flavor name="m1.tiny">
Oct 16 07:48:43 user nova-compute[74080]:         <nova:memory>512</nova:memory>
Oct 16 07:48:43 user nova-compute[74080]:         <nova:disk>1</nova:disk>
Oct 16 07:48:43 user nova-compute[74080]:         <nova:swap>0</nova:swap>
Oct 16 07:48:43 user nova-compute[74080]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 07:48:43 user nova-compute[74080]:         <nova:vcpus>1</nova:vcpus>
Oct 16 07:48:43 user nova-compute[74080]:       </nova:flavor>
Oct 16 07:48:43 user nova-compute[74080]:       <nova:owner>
Oct 16 07:48:43 user nova-compute[74080]:         <nova:user uuid="bf2fbffe5a5544dba338662d437d5ee2">tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member</nova:user>
Oct 16 07:48:43 user nova-compute[74080]:         <nova:project uuid="cea8d62574f84ae6a83ee19b7b03c21a">tempest-ServerBootFromVolumeStableRescueTest-1639701158</nova:project>
Oct 16 07:48:43 user nova-compute[74080]:       </nova:owner>
Oct 16 07:48:43 user nova-compute[74080]:       <nova:root type="image" uuid="f8d6ec0a-e025-4b3f-8896-9e692aff07e8"/>
Oct 16 07:48:43 user nova-compute[74080]:       <nova:ports>
Oct 16 07:48:43 user nova-compute[74080]:         <nova:port uuid="32dcc8e2-99aa-4580-b8a8-1b0f04898fec">
Oct 16 07:48:43 user nova-compute[74080]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 07:48:43 user nova-compute[74080]:         </nova:port>
Oct 16 07:48:43 user nova-compute[74080]:       </nova:ports>
Oct 16 07:48:43 user nova-compute[74080]:     </nova:instance>
Oct 16 07:48:43 user nova-compute[74080]:   </metadata>
Oct 16 07:48:43 user nova-compute[74080]:   <sysinfo type="smbios">
Oct 16 07:48:43 user nova-compute[74080]:     <system>
Oct 16 07:48:43 user nova-compute[74080]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 07:48:43 user nova-compute[74080]:       <entry name="product">OpenStack Nova</entry>
Oct 16 07:48:43 user nova-compute[74080]:       <entry name="version">0.0.0</entry>
Oct 16 07:48:43 user nova-compute[74080]:       <entry name="serial">1bbb6b64-9bad-4d7d-820a-60ea529f4135</entry>
Oct 16 07:48:43 user nova-compute[74080]:       <entry name="uuid">1bbb6b64-9bad-4d7d-820a-60ea529f4135</entry>
Oct 16 07:48:43 user nova-compute[74080]:       <entry name="family">Virtual Machine</entry>
Oct 16 07:48:43 user nova-compute[74080]:     </system>
Oct 16 07:48:43 user nova-compute[74080]:   </sysinfo>
Oct 16 07:48:43 user nova-compute[74080]:   <os>
Oct 16 07:48:43 user nova-compute[74080]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 07:48:43 user nova-compute[74080]:     <boot dev="hd"/>
Oct 16 07:48:43 user nova-compute[74080]:     <smbios mode="sysinfo"/>
Oct 16 07:48:43 user nova-compute[74080]:   </os>
Oct 16 07:48:43 user nova-compute[74080]:   <features>
Oct 16 07:48:43 user nova-compute[74080]:     <acpi/>
Oct 16 07:48:43 user nova-compute[74080]:     <apic/>
Oct 16 07:48:43 user nova-compute[74080]:     <vmcoreinfo/>
Oct 16 07:48:43 user nova-compute[74080]:   </features>
Oct 16 07:48:43 user nova-compute[74080]:   <clock offset="utc">
Oct 16 07:48:43 user nova-compute[74080]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 07:48:43 user nova-compute[74080]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 07:48:43 user nova-compute[74080]:     <timer name="hpet" present="no"/>
Oct 16 07:48:43 user nova-compute[74080]:   </clock>
Oct 16 07:48:43 user nova-compute[74080]:   <cpu mode="custom" match="exact">
Oct 16 07:48:43 user nova-compute[74080]:     <model>Nehalem</model>
Oct 16 07:48:43 user nova-compute[74080]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 07:48:43 user nova-compute[74080]:   </cpu>
Oct 16 07:48:43 user nova-compute[74080]:   <devices>
Oct 16 07:48:43 user nova-compute[74080]:     <disk type="block" device="disk">
Oct 16 07:48:43 user nova-compute[74080]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 07:48:43 user nova-compute[74080]:       <source dev="/dev/sdd"/>
Oct 16 07:48:43 user nova-compute[74080]:       <target dev="vda" bus="virtio"/>
Oct 16 07:48:43 user nova-compute[74080]:       <serial>1da84b4a-7806-49f5-a0c3-f4f461d34520</serial>
Oct 16 07:48:43 user nova-compute[74080]:     </disk>
Oct 16 07:48:43 user nova-compute[74080]:     <interface type="ethernet">
Oct 16 07:48:43 user nova-compute[74080]:       <mac address="fa:16:3e:0e:74:ad"/>
Oct 16 07:48:43 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:48:43 user nova-compute[74080]:       <mtu size="1442"/>
Oct 16 07:48:43 user nova-compute[74080]:       <target dev="tap32dcc8e2-99"/>
Oct 16 07:48:43 user nova-compute[74080]:     </interface>
Oct 16 07:48:43 user nova-compute[74080]:     <serial type="pty">
Oct 16 07:48:43 user nova-compute[74080]:       <log file="/opt/stack/data/nova/instances/1bbb6b64-9bad-4d7d-820a-60ea529f4135/console.log" append="off"/>
Oct 16 07:48:43 user nova-compute[74080]:     </serial>
Oct 16 07:48:43 user nova-compute[74080]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 07:48:43 user nova-compute[74080]:     <video>
Oct 16 07:48:43 user nova-compute[74080]:       <model type="virtio"/>
Oct 16 07:48:43 user nova-compute[74080]:     </video>
Oct 16 07:48:43 user nova-compute[74080]:     <rng model="virtio">
Oct 16 07:48:43 user nova-compute[74080]:       <backend model="random">/dev/urandom</backend>
Oct 16 07:48:43 user nova-compute[74080]:     </rng>
Oct 16 07:48:43 user nova-compute[74080]:     <controller type="usb" index="0" model="none"/>
Oct 16 07:48:43 user nova-compute[74080]:     <memballoon model="virtio">
Oct 16 07:48:43 user nova-compute[74080]:       <stats period="10"/>
Oct 16 07:48:43 user nova-compute[74080]:     </memballoon>
Oct 16 07:48:43 user nova-compute[74080]:   </devices>
Oct 16 07:48:43 user nova-compute[74080]: </domain>
Oct 16 07:48:43 user nova-compute[74080]:  {{(pid=74080) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-761684220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-761684220',id=42,image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cea8d62574f84ae6a83ee19b7b03c21a',ramdisk_id='',reservation_id='r-8zxrgj3u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f8d6ec0a-e025-4b3f-8896-9e692aff07e8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:47:45Z,user_data=None,user_id='bf2fbffe5a5544dba338662d437d5ee2',uuid=1bbb6b64-9bad-4d7d-820a-60ea529f4135,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converting VIF {"id": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "address": "fa:16:3e:0e:74:ad", "network": {"id": "f6797d8b-a34c-4306-b1f2-af6d6071b419", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1116485805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cea8d62574f84ae6a83ee19b7b03c21a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32dcc8e2-99", "ovs_interfaceid": "32dcc8e2-99aa-4580-b8a8-1b0f04898fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:ad,bridge_name='br-int',has_traffic_filtering=True,id=32dcc8e2-99aa-4580-b8a8-1b0f04898fec,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32dcc8e2-99') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG os_vif [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:ad,bridge_name='br-int',has_traffic_filtering=True,id=32dcc8e2-99aa-4580-b8a8-1b0f04898fec,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32dcc8e2-99') {{(pid=74080) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '193e8864-ddb2-5c41-a030-acc637a0b147', '_type': 'linux-noop'}}, row=False) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32dcc8e2-99, may_exist=True, interface_attrs={}) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32dcc8e2-99, col_values=(('qos', UUID('f4cb06e0-f8da-4cfc-b1c9-e6e26b217a5b')),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32dcc8e2-99, col_values=(('external_ids', {'iface-id': '32dcc8e2-99aa-4580-b8a8-1b0f04898fec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:74:ad', 'vm-uuid': '1bbb6b64-9bad-4d7d-820a-60ea529f4135'}),), if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:43 user nova-compute[74080]: INFO os_vif [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:74:ad,bridge_name='br-int',has_traffic_filtering=True,id=32dcc8e2-99aa-4580-b8a8-1b0f04898fec,network=Network(f6797d8b-a34c-4306-b1f2-af6d6071b419),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32dcc8e2-99')
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74080) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 07:48:43 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] No VIF found with MAC fa:16:3e:0e:74:ad, not building metadata {{(pid=74080) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 07:48:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:44 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-07bf80a7-254b-4ad8-9c6a-ea4532e73716 req-0ba16743-97cb-41bb-8d61-2a95911e57a2 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Received event network-vif-plugged-32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-07bf80a7-254b-4ad8-9c6a-ea4532e73716 req-0ba16743-97cb-41bb-8d61-2a95911e57a2 service nova] Acquiring lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-07bf80a7-254b-4ad8-9c6a-ea4532e73716 req-0ba16743-97cb-41bb-8d61-2a95911e57a2 service nova] Lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:45 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-07bf80a7-254b-4ad8-9c6a-ea4532e73716 req-0ba16743-97cb-41bb-8d61-2a95911e57a2 service nova] Lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:45 user nova-compute[74080]: DEBUG nova.compute.manager [req-07bf80a7-254b-4ad8-9c6a-ea4532e73716 req-0ba16743-97cb-41bb-8d61-2a95911e57a2 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] No waiting events found dispatching network-vif-plugged-32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:48:45 user nova-compute[74080]: WARNING nova.compute.manager [req-07bf80a7-254b-4ad8-9c6a-ea4532e73716 req-0ba16743-97cb-41bb-8d61-2a95911e57a2 service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Received unexpected event network-vif-plugged-32dcc8e2-99aa-4580-b8a8-1b0f04898fec for instance with vm_state building and task_state spawning.
Oct 16 07:48:45 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Received event network-changed-e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG nova.compute.manager [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Refreshing instance network info cache due to event network-changed-e6a36ae1-ea7b-4e90-b70d-424902807b64. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] Acquiring lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] Acquired lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Refreshing network info cache for port e6a36ae1-ea7b-4e90-b70d-424902807b64 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updated VIF entry in instance network info cache for port e6a36ae1-ea7b-4e90-b70d-424902807b64. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG nova.network.neutron [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] [instance: dd394796-510c-4990-aaa7-7f479173c476] Updating instance_info_cache with network_info: [{"id": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "address": "fa:16:3e:cb:d0:4f", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a36ae1-ea", "ovs_interfaceid": "e6a36ae1-ea7b-4e90-b70d-424902807b64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:48:46 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-2f75e9b2-a079-4030-bb38-0a360b16d41c req-c5d67e5a-8539-46c0-a2e7-953dbad7526a service nova] Releasing lock "refresh_cache-dd394796-510c-4990-aaa7-7f479173c476" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-c7865f68-d8a7-4526-b63c-b00158c33803 req-9d8070aa-b2f4-42de-ba3f-a6180412cfdd service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Received event network-vif-plugged-32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7865f68-d8a7-4526-b63c-b00158c33803 req-9d8070aa-b2f4-42de-ba3f-a6180412cfdd service nova] Acquiring lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7865f68-d8a7-4526-b63c-b00158c33803 req-9d8070aa-b2f4-42de-ba3f-a6180412cfdd service nova] Lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-c7865f68-d8a7-4526-b63c-b00158c33803 req-9d8070aa-b2f4-42de-ba3f-a6180412cfdd service nova] Lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.compute.manager [req-c7865f68-d8a7-4526-b63c-b00158c33803 req-9d8070aa-b2f4-42de-ba3f-a6180412cfdd service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] No waiting events found dispatching network-vif-plugged-32dcc8e2-99aa-4580-b8a8-1b0f04898fec {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:48:47 user nova-compute[74080]: WARNING nova.compute.manager [req-c7865f68-d8a7-4526-b63c-b00158c33803 req-9d8070aa-b2f4-42de-ba3f-a6180412cfdd service nova] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Received unexpected event network-vif-plugged-32dcc8e2-99aa-4580-b8a8-1b0f04898fec for instance with vm_state building and task_state spawning.
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Instance event wait completed in 0 seconds for  {{(pid=74080) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Guest created on hypervisor {{(pid=74080) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 07:48:47 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Instance spawned successfully.
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Found default for hw_cdrom_bus of ide {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Found default for hw_disk_bus of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Found default for hw_input_bus of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Found default for hw_pointer_model of None {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Found default for hw_video_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Found default for hw_vif_model of virtio {{(pid=74080) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 07:48:47 user nova-compute[74080]: INFO nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Took 5.54 seconds to spawn the instance on the hypervisor.
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Checking state {{(pid=74080) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 07:48:47 user nova-compute[74080]: INFO nova.compute.manager [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] [instance: 1bbb6b64-9bad-4d7d-820a-60ea529f4135] Took 63.67 seconds to build instance.
Oct 16 07:48:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-38cc6168-a25b-453d-b0b0-3a0939144ef0 tempest-ServerBootFromVolumeStableRescueTest-1639701158 tempest-ServerBootFromVolumeStableRescueTest-1639701158-project-member] Lock "1bbb6b64-9bad-4d7d-820a-60ea529f4135" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 63.794s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.compute.manager [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Stashing vm_state: active {{(pid=74080) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:47 user nova-compute[74080]: DEBUG nova.virt.hardware [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74080) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 07:48:47 user nova-compute[74080]: INFO nova.compute.claims [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Claim successful on node user
Oct 16 07:48:48 user nova-compute[74080]: INFO nova.compute.resource_tracker [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updating resource usage from migration 0726355c-5935-4ead-a831-37647bdd07eb
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received event network-changed-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.compute.manager [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Refreshing instance network info cache due to event network-changed-3b6cdf68-626e-4472-9e45-a9bbb5ec0630. {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] Acquiring lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] Acquired lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.network.neutron [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Refreshing network info cache for port 3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.compute.provider_tree [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed in ProviderTree for provider: b5aa9fe6-2f98-4919-84cb-476610cf1fc7 {{(pid=74080) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.scheduler.client.report [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Inventory has not changed for provider b5aa9fe6-2f98-4919-84cb-476610cf1fc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74080) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.741s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:48 user nova-compute[74080]: INFO nova.compute.manager [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Migrating
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.network.neutron [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updated VIF entry in instance network info cache for port 3b6cdf68-626e-4472-9e45-a9bbb5ec0630. {{(pid=74080) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.network.neutron [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updating instance_info_cache with network_info: [{"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-3c99d57a-34de-4191-a2a0-28b74a10d6ab req-1e1fd9bb-16a8-4687-b07b-8ba707763507 service nova] Releasing lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquired lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:48:48 user nova-compute[74080]: DEBUG nova.network.neutron [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG nova.network.neutron [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updating instance_info_cache with network_info: [{"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Releasing lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Starting migrate_disk_and_power_off {{(pid=74080) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-7a1c01c7-9b12-4fc5-b254-656127ec521b req-ef75bd75-bfcc-4d84-9714-d9a3746bbb7c service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received event network-vif-unplugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7a1c01c7-9b12-4fc5-b254-656127ec521b req-ef75bd75-bfcc-4d84-9714-d9a3746bbb7c service nova] Acquiring lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7a1c01c7-9b12-4fc5-b254-656127ec521b req-ef75bd75-bfcc-4d84-9714-d9a3746bbb7c service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-7a1c01c7-9b12-4fc5-b254-656127ec521b req-ef75bd75-bfcc-4d84-9714-d9a3746bbb7c service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG nova.compute.manager [req-7a1c01c7-9b12-4fc5-b254-656127ec521b req-ef75bd75-bfcc-4d84-9714-d9a3746bbb7c service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] No waiting events found dispatching network-vif-unplugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:48:49 user nova-compute[74080]: WARNING nova.compute.manager [req-7a1c01c7-9b12-4fc5-b254-656127ec521b req-ef75bd75-bfcc-4d84-9714-d9a3746bbb7c service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received unexpected event network-vif-unplugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 for instance with vm_state active and task_state resize_migrating.
Oct 16 07:48:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:49 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:50 user nova-compute[74080]: INFO nova.virt.libvirt.driver [-] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Instance destroyed successfully.
Oct 16 07:48:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.vif [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T07:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-735357343',display_name='tempest-ServerActionsTestOtherA-server-735357343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-735357343',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZLgcCjtOjRhtVEk66lTNvJCeVtg0/HRqeB+2N63b7XuoepjdGinmp3abF9v/R3VFjwY/zIQcPIO8tqTm4LN5wPV1fx01ZgUseGdlfitkfPwyEsROdJBfZEWEz0lOUgsQ==',key_name='tempest-keypair-108407981',keypairs=<?>,launch_index=0,launched_at=2023-10-16T07:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ee952431351406291cab2310d4a54fd',ramdisk_id='',reservation_id='r-ebk5czgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-481627845',owner_user_name='tempest-ServerActionsTestOtherA-481627845-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T07:48:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c63d981ba0f4e5fa162e8f2cd6064b9',uuid=88dbb56c-82a7-46ca-b8eb-808d56b624ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-103260107-network", "vif_mac": "fa:16:3e:7f:7c:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converting VIF {"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-103260107-network", "vif_mac": "fa:16:3e:7f:7c:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG nova.network.os_vif_util [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:7c:a2,bridge_name='br-int',has_traffic_filtering=True,id=3b6cdf68-626e-4472-9e45-a9bbb5ec0630,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b6cdf68-62') {{(pid=74080) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_vif [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:7c:a2,bridge_name='br-int',has_traffic_filtering=True,id=3b6cdf68-626e-4472-9e45-a9bbb5ec0630,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b6cdf68-62') {{(pid=74080) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b6cdf68-62, bridge=br-int, if_exists=True) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=005e139a-6933-4bca-a747-b34f0e7fd2e5) {{(pid=74080) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74080) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 07:48:50 user nova-compute[74080]: INFO os_vif [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:7c:a2,bridge_name='br-int',has_traffic_filtering=True,id=3b6cdf68-626e-4472-9e45-a9bbb5ec0630,network=Network(3cbca8e6-6217-4cd2-a270-914a43609f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b6cdf68-62')
Oct 16 07:48:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] calling os-brick to detach iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc7ac711c30>, {'target_iqn': 'iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYzcZwCu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:48:50 user nova-compute[74080]: WARNING os_brick.initiator.connectors.base [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f13037b-0a00-485f-b8df-cc74c18ec1e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 07:48:50 user nova-compute[74080]: No targets found.
Oct 16 07:48:50 user nova-compute[74080]: iSNS:
Oct 16 07:48:50 user nova-compute[74080]: No targets found.
Oct 16 07:48:50 user nova-compute[74080]: STATIC:
Oct 16 07:48:50 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5
Oct 16 07:48:50 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:50 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:50 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84
Oct 16 07:48:50 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:50 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:50 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1
Oct 16 07:48:50 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:50 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:50 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a
Oct 16 07:48:50 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:50 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:50 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043
Oct 16 07:48:50 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:50 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:50 user nova-compute[74080]: Target: iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520
Oct 16 07:48:50 user nova-compute[74080]:         Portal: 172.16.0.220:3260,-1
Oct 16 07:48:50 user nova-compute[74080]:                 Iface Name: default
Oct 16 07:48:50 user nova-compute[74080]: FIRMWARE:
Oct 16 07:48:50 user nova-compute[74080]: No targets found.
Oct 16 07:48:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 07:48:50 user nova-compute[74080]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 07:48:50 user nova-compute[74080]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74080) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043', 0)] {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[18684913-1791-4406-b6ca-18d95f9c4b47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f2167b-8cdf-4f05-b738-0aaf1c9e2680]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 (non-flash)\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7981707-d7a7-4db0-bd60-4d86f01386c5 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abde53f-ca40-4805-89b6-7274eb9fad84 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69230c1c-d58b-47f4-9119-a95e4789478a (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:764a5f7a-ff0e-4fce-bc56-1b3d6db354d1 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1da84b4a-7806-49f5-a0c3-f4f461d34520 (non-flash)
Oct 16 07:48:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc7cff825f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043'): ({'sde'}, set())}) {{(pid=74080) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Removing single pathed devices sde {{(pid=74080) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b8da88-0855-40f0-b660-aad7d546e6ec]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea3db0-1ab8-4304-9949-97dbed24c206]: (4, ('ok\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Flushing IO for device /dev/sde {{(pid=74080) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbbca48-4755-4d3c-9b31-edaa5e80e176]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74080) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[da188ac8-a830-4009-926e-cbed2df6034e]: (4, ('1', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.linuxscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] SCSI volumes sde have been removed. {{(pid=74080) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043')] {{(pid=74080) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d25bc-b99a-4215-8abf-806c2a850774]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --logout {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51881d7-2c53-4d67-96a4-f7d622693270]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260]
Oct 16 07:48:50 user nova-compute[74080]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043, portal: 172.16.0.220,3260] successful.
Oct 16 07:48:50 user nova-compute[74080]:  stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op delete {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b0d2ca9-5bfa-42ad-990a-e0da99744043 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[b712e39e-d20c-47cb-b9c8-096821497ff7]: (4, ('', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74080) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.base [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== disconnect_volume: return (413ms) None {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Disconnected iSCSI Volume {{(pid=74080) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 07:48:50 user nova-compute[74080]: DEBUG nova.virt.libvirt.driver [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74080) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 07:48:51 user nova-compute[74080]: DEBUG nova.network.neutron [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Port 3b6cdf68-626e-4472-9e45-a9bbb5ec0630 binding to destination host user is already ACTIVE {{(pid=74080) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 07:48:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-d9dca6f1-fc1f-4c3e-8bf4-79ce803eed55 req-718785c1-55bc-4fda-9c2c-af52a57353fb service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received event network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 07:48:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d9dca6f1-fc1f-4c3e-8bf4-79ce803eed55 req-718785c1-55bc-4fda-9c2c-af52a57353fb service nova] Acquiring lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d9dca6f1-fc1f-4c3e-8bf4-79ce803eed55 req-718785c1-55bc-4fda-9c2c-af52a57353fb service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:51 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [req-d9dca6f1-fc1f-4c3e-8bf4-79ce803eed55 req-718785c1-55bc-4fda-9c2c-af52a57353fb service nova] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:51 user nova-compute[74080]: DEBUG nova.compute.manager [req-d9dca6f1-fc1f-4c3e-8bf4-79ce803eed55 req-718785c1-55bc-4fda-9c2c-af52a57353fb service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] No waiting events found dispatching network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 {{(pid=74080) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 07:48:51 user nova-compute[74080]: WARNING nova.compute.manager [req-d9dca6f1-fc1f-4c3e-8bf4-79ce803eed55 req-718785c1-55bc-4fda-9c2c-af52a57353fb service nova] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Received unexpected event network-vif-plugged-3b6cdf68-626e-4472-9e45-a9bbb5ec0630 for instance with vm_state active and task_state resize_migrating.
Oct 16 07:48:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 07:48:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 07:48:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Lock "88dbb56c-82a7-46ca-b8eb-808d56b624ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74080) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 07:48:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquiring lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 07:48:52 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Acquired lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 07:48:52 user nova-compute[74080]: DEBUG nova.network.neutron [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Building network info cache for instance {{(pid=74080) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 07:48:52 user nova-compute[74080]: DEBUG nova.network.neutron [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] [instance: 88dbb56c-82a7-46ca-b8eb-808d56b624ba] Updating instance_info_cache with network_info: [{"id": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "address": "fa:16:3e:7f:7c:a2", "network": {"id": "3cbca8e6-6217-4cd2-a270-914a43609f7a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-103260107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee952431351406291cab2310d4a54fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b6cdf68-62", "ovs_interfaceid": "3b6cdf68-626e-4472-9e45-a9bbb5ec0630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74080) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.lockutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Releasing lock "refresh_cache-88dbb56c-82a7-46ca-b8eb-808d56b624ba" {{(pid=74080) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG os_brick.utils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dc3e5c-19a5-4e4b-8e8f-60f9293155f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:d24f148543f5\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089d108-948e-4735-86a8-31e23e5f9bbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[67798d30-2adf-4ec2-bbab-58a317651ae3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f953bb6-e334-4f5d-ab31-d5144ed2f84d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] Running cmd (subprocess): nvme version {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] 'nvme version' failed. Not Retrying. {{(pid=74080) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.nvmeof [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] nvme not present on system {{(pid=74080) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85089) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 07:48:53 user nova-compute[74080]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 07:48:53 user nova-compute[74080]: DEBUG oslo.privsep.daemon [-] privsep: reply[feddc873-b157-4dbc-9b41-895bea889d8d]: (4, '') {{(pid=85089) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74080) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG os_brick.initiator.connectors.lightos [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] LIGHTOS: no hostnqn found. {{(pid=74080) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 07:48:53 user nova-compute[74080]: DEBUG os_brick.utils [None req-914166c7-583e-4735-913c-f794721704a8 tempest-ServerActionsTestOtherA-481627845 tempest-ServerActionsTestOtherA-481627845-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:d24f148543f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74080) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}